Data adapting device, data adapting method, storage medium, and program

ABSTRACT

The present invention makes it possible to achieve data adaptation in accordance with a user&#39;s preferences, by holding a user&#39;s preference information for each content as user preferences, selecting a data segment according to user preferences, and performing resolution conversion on the basis of segment priority level and terminal capability, thereby enabling data adaptation to be performed for each content in a form the user wishes to see.

TECHNICAL FIELD

[0001] The present invention relates to a data adaptation apparatus and data adaptation method for adapting data to the preferences of a user, and a recording medium that includes a data adaptation apparatus. In particular, the present invention relates to a data adaptation apparatus for data including video, audio, and documents provided via broadcasting or communication media such as digital broadcasting or the Internet.

BACKGROUND ART

[0002] In recent years, there has been an active trend of digitalization of broadcasting, and fusion with communications has also progressed. In the field of communications, satellite digital broadcasting has already been started, and it is expected that terrestrial broadcasting will also be digitalized in the future. As a result of digitalization of broadcast contents, data broadcasting is also performed in addition to conventional video and audio. Products that realize the concept of storing television broadcasts on a hard disk and playing them back later (TV Anytime), such as TiVo (www.tivo.com) and ReplayTV (www.replaytv.com), are also on the market in the United States. Also, in the communications field, digital content distribution via the Internet has begun with music, and the number of Internet broadcasting stations that broadcast video is also increasing. In addition, access to Internet content has also been made possible for portable terminals through wideband access networks and connection to the Internet.

[0003] Amid such dramatic changes in information infrastructure, it is envisaged that henceforth it will become possible for users to easily access enormous information sources including video, audio, documents, and the like. Due to the fusion and digitalization of communications and broadcasting in this way, it has become difficult for users to handle enormous information sources without selectively transmitting and replaying only information that accords with the preferences of a user by using metadata that describes content. As shown in “Adapting Multimedia Internet Content For Universal Access” (IEEE Transactions on Multimedia, March 1999, pp.104-114), there have been proposed a description scheme for distributing one content to various terminals such as televisions and portable terminals, and accessing rich content on the Internet from an HHC (Hand Held Computer), PDA (Personal Digital Assistant), Smart Phone, or the like, and a method for converting (performing data adaptation of) Internet content according to the display capability of a terminal (for example, by changing the display size or number of display colors).

[0004] A conventional data adaptation apparatus will be described below. FIG. 68 shows a block diagram of a conventional data adaptation apparatus. A conventional data adaptation apparatus consists of a data adaptation section 100, a policy engine 101, a content analysis section 102, a content selection section 103, a content manipulation section 104, and a terminal 105. Internet content d1001 is input to the content analysis section 102. Terminal preferences d1002 that indicate terminal 105 performance information are stored in the terminal 105.

[0005]FIG. 69 is a detailed drawing of terminal preferences d1002. Terminal preferences d1002 contain screen color number information x and screen size information axb indicating the display capability of the terminal 105.

[0006] The operation of a data adaptation section configured as described above will be described below using FIG. 70. FIG. 70 is processing flowchart that describes the operation of the data adaptation section 100.

[0007] The policy engine 101 identifies the display screen size and number of display colors as the terminal capability according to terminal preferences d1002 obtained from the terminal 105 (P1201). The policy engine 101 then controls the content selection section 103 and content manipulation section 104 according to the information and policy identified in P1201.

[0008] The content analysis section 102 analyzes the physical data type of Internet content d1001 requested by the user (P1202). Then, the content selection section 103 judges whether display of the Internet content d1001 is possible with the display capability of the terminal 105 (P1203), and if the capability is sufficient to display the Internet content d1001, selects only content that can be displayed with the terminal capability from the Internet content d1001 (P1204).

[0009] Then, the content manipulation section 104 further converts the displayable content selected in P1204 to a form that can be displayed with the terminal capability. Specifically, the content selection section 103 judges whether the content is larger than the display screen size (P1205), and content larger than the display screen size is reduced in size by the content manipulation section 104 (P1206). If the content is not larger than the display screen size, the content manipulation section 104 judges whether the content is smaller than the display capability (P1207), and small content is enlarged by the content manipulation section 104 (P1208).

[0010] The content manipulation section 104 also judges whether the number of display colors of the terminal 105 are colors (P1209). Then, if the number of display colors of the terminal 105 are not colors, the content manipulation section 104 judges whether they are gray-scale (P1210), and if they are gray-scale, converts the content number of colors to gray-scale (P1211), and if they are neither colors nor gray-scale, performs binary conversion (P1212).

[0011] However, with the above-described conventional technology, a general policy is carried out-that is, selection and manipulation of content based on the result of content analysis in accordance with a policy suited to a specific terminal. Consequently, there is a problem in that it is only possible to perform data adaptation according to a predetermined fixed number of terminal patterns.

[0012] Also, with the conventional technology, it is not possible to perform selection and manipulation of content according to the preferences of the user: for example, selection and manipulation to display part of an image rather than reducing it in size. Therefore, with the conventional technology, even in a case where content selection and manipulation are performed using a predetermined specific terminal, there is a problem in that the user cannot perform data adaptation of content in a form according to his or her preferences using that terminal.

DISCLOSURE OF INVENTION

[0013] It is a first objective of the present invention to perform data adaptation of content in a form according to the user's preferences by selecting a data segment according to user preference information.

[0014] It is a second objective of the present invention to perform data adaptation of content, when content is distributed via a network, in a form in which the user wishes to receive it and in a scalable fashion according to the network status.

[0015] In order to meet the above-described first objective, the present invention performs data adaptation in a form the user wishes to see for each content by holding user preference information as user preferences, selecting a data segment according to the user preferences, and performing resolution conversion on the basis of the segment priority and terminal capability. By this means, it is possible to perform data adaptation fully in accordance with the user's preferences.

[0016] Also, in order to meet the above-described second objective, the present invention performs data adaptation of content in a form in which the user wishes to receive it and in a scalable fashion according to the network status by acquiring information on the network transmission band as a network preference when content is distributed via a network, and adjusting the data quantity according to the segment priority and transmission band. By this means, it is possible to perform data adaptation in a form in which the user wishes to receive it and in a scalable fashion according to the network status.

BRIEF DESCRIPTION OF DRAWINGS

[0017]FIG. 1 is a block diagram of a terminal provided with a data adaptation apparatus according to Embodiment 1 and Embodiment 3 of the present invention;

[0018]FIG. 2 is a detailed drawing of user preferences according to Embodiment 1;

[0019]FIG. 3 is a drawing showing description definitions of user preferences according to Embodiment 1;

[0020]FIG. 4 is a drawing showing a sample description of user preferences according to Embodiment 1;

[0021]FIG. 5 is an explanatory drawing of the operation of the segment selection section according to Embodiment 1;

[0022]FIG. 6 is a processing flowchart of the user adaptive control section according to Embodiment 1;

[0023]FIG. 7 is a processing flowchart of the terminal adaptive control section according to Embodiment 1;

[0024]FIG. 8 is a block diagram of a system provided with a data adaptation apparatus according to Embodiment 2 and Embodiment 4 of the present invention;

[0025]FIG. 9 is a processing flowchart of the network adaptive control section according to Embodiment 2;

[0026]FIG. 10 is a detailed drawing showing a second example of user preferences;

[0027]FIG. 11 is a detailed drawing showing second description definitions of user preferences;

[0028]FIG. 12 is a detailed drawing showing a second sample description of user preferences;

[0029]FIG. 13 is a drawing explaining second operation of the segment selection section;

[0030]FIG. 14 is a flowchart of second processing of the user adaptive control section;

[0031]FIG. 15 is a block diagram showing another example of a system provided with a data adaptation apparatus according to an embodiment of the present invention;

[0032]FIG. 16 is a drawing showing another mode of segments according to an embodiment of the present invention;

[0033]FIG. 17 is a drawing showing examples of segment descriptions according to an embodiment of the present invention;

[0034]FIG. 18 is a drawing showing the data structure according to Embodiment 5 of the present invention;

[0035]FIG. 19 is a drawing showing an example of data descriptions according to Embodiment 5 of the present invention;

[0036]FIG. 20 is a drawing showing another example of the data structure according to Embodiment 5 of the present invention;

[0037]FIG. 21 is a drawing showing another example of descriptions of the data structure according to Embodiment 5 of the present invention;

[0038]FIG. 22 is a drawing showing the data structure according to Embodiment 6 of the present invention;

[0039]FIG. 23 is a drawing showing an example of data descriptions according to Embodiment 6 of the present invention;

[0040]FIG. 24 is a drawing showing the data structure according to Embodiment 7 of the present invention;

[0041]FIG. 25 is a drawing showing data descriptions according to Embodiment 7 of the present invention;

[0042]FIG. 26 is a drawing showing another example of the data structure according to Embodiment 7 of the present invention;

[0043]FIG. 27 is a drawing showing another example of descriptions of a data structure according to Embodiment 7 of the present invention;

[0044]FIG. 28 is a drawing showing the data structure according to Embodiment 8 of the present invention;

[0045]FIG. 29 is a drawing showing data descriptions according to Embodiment 8 of the present invention;

[0046]FIG. 30 is a drawing showing another example of the data structure according to Embodiment 8 of the present invention;

[0047]FIG. 31 is a drawing showing another example of descriptions of a data structure according to Embodiment 8 of the present invention;

[0048]FIG. 32 is a first drawing showing description definitions of user preferences according to Embodiment 9 of the present invention;

[0049]FIG. 33 is a second drawing showing description definitions of user preferences according to Embodiment 9 of the present invention;

[0050]FIG. 34 is a drawing showing a sample description of user preferences according to Embodiment 9 of the present invention;

[0051]FIG. 35 is a first drawing showing segment description definitions according to Embodiment 9;

[0052]FIG. 36 is a second drawing showing segment description definitions according to Embodiment 9;

[0053]FIG. 37 is a third drawing showing segment description definitions according to Embodiment 9;

[0054]FIG. 38 is a drawing showing a first sample segment description according to Embodiment 9;

[0055]FIG. 39 is a drawing showing a second sample segment description according to Embodiment 9;

[0056]FIG. 40 is a drawing showing a third sample segment description according to Embodiment 9;

[0057]FIG. 41 is a drawing showing a fourth sample segment description according to Embodiment 9;

[0058]FIG. 42 is a drawing showing a fifth sample segment description according to Embodiment 9;

[0059]FIG. 43 is a drawing showing a sixth sample segment description according to Embodiment 9;

[0060]FIG. 44 is a drawing showing a seventh sample segment description according to Embodiment 9;

[0061]FIG. 45 is a drawing showing an eighth sample segment description according to Embodiment 9;

[0062]FIG. 46 is a drawing showing a ninth sample segment description according to Embodiment 9;

[0063]FIG. 47 is a first drawing showing user preference description definitions according to Embodiment 10 of the present invention;

[0064]FIG. 48 is a second drawing showing user preference description definitions according to Embodiment 10;

[0065]FIG. 49 is a third drawing showing user preference description definitions according to Embodiment 10;

[0066]FIG. 50 is a fourth drawing showing user preference description definitions according to Embodiment 10;

[0067]FIG. 51 is a fifth drawing showing user preference description definitions according to Embodiment 10;

[0068]FIG. 52 is a drawing showing a sample user preference description according to Embodiment 10;

[0069]FIG. 53 is a first drawing showing segment description definitions according to Embodiment 10;

[0070]FIG. 54 is a second drawing showing segment description definitions according to Embodiment 10;

[0071]FIG. 55 is a third drawing showing segment description definitions according to Embodiment 10;

[0072]FIG. 56 is a fourth drawing showing segment description definitions according to Embodiment 10;

[0073]FIG. 57 is a first drawing showing a sample segment description according to Embodiment 10;

[0074]FIG. 58 is a second drawing showing a sample segment description according to Embodiment 10;

[0075]FIG. 59 is a third drawing showing a sample segment description according to Embodiment 10;

[0076]FIG. 60 is a first drawing showing another example of a segment description according to Embodiment 10;

[0077]FIG. 61 is a second drawing showing another example of a segment description according to Embodiment 10;

[0078]FIG. 62 is a first drawing showing digest description definitions according to Embodiment 11;

[0079]FIG. 63 is a second drawing showing digest description definitions according to Embodiment 11;

[0080]FIG. 64 is a third drawing showing digest description definitions according to Embodiment 11;

[0081]FIG. 65 is a fourth drawing showing digest description definitions according to Embodiment 11;

[0082]FIG. 66 is a drawing showing an example of a point of view list description according to an embodiment;

[0083]FIG. 67 is a drawing showing an example of a digest description according to Embodiment 11;

[0084]FIG. 68 is a block diagram of a conventional data adaptation apparatus;

[0085]FIG. 69 is a detailed drawing of a conventional terminal preference description; and

[0086]FIG. 70 is a processing flowchart of a conventional data adaptation section.

BEST MODE FOR CARRYING OUT THE INVENTION

[0087] With reference now to the attached drawings, embodiments of the present invention will be explained in detail below.

Embodiment 1

[0088] A terminal provided with a data adaptation apparatus according to Embodiment 1 of the present invention will be described below. FIG. 1 is a block diagram of a terminal provided with a data adaptation apparatus according to Embodiment 1. As shown in FIG. 1, a terminal 10 is composed of a content data storage medium 11 on which is stored data d102 consisting of content composed of a plurality of segments and metadata d101 which is information for describing the data d102, a user preference storage section 19 that stores user preferences d103 which comprise information relating to the user's preferences, a terminal preference storage section 20 that stores terminal preferences d104 which comprise terminal capability information, and a user adaptation section 12 that adapts the data d102 to the user's preferences using the metadata d101, user preferences d103, and terminal preferences d104.

[0089] The user adaptation section 12 is provided with means for acquiring various kinds of data. Provided as means for acquiring various kinds of data are a content data acquisition section 21 consisting of a metadata acquisition section 21 a that acquires metadata d101 and a data acquisition section 21 b that acquires data d102, a user preference acquisition section 22 that acquires user preferences d103, and a terminal preference acquisition section 23 that acquires terminal preferences d104.

[0090] In addition, the user adaptation section 12 is provided with means for selecting a predetermined segment from the data d102 acquired in accordance with the user's preferences and adapting it to the user's preferences. Provided as means for adapting a selected segment to the user's preferences are a user adaptive control section 14 that generates information for selecting a predetermined segment from acquired data d102 using acquired metadata d101 and user preference data d103, and a segment selection section 16 that selects and extracts a predetermined segment from acquired data d102 on the basis of information generated by the user adaptive control section 14.

[0091] Moreover, the user adaptation section 12 is provided with means for converting data d102 in accordance with the terminal capability of, for instance, a display section 18 which is a data d102 processing apparatus. Provided as means for converting data d102 in accordance with the terminal capability are a terminal adaptive control section 15 that generates information for varying the spatial resolution and color resolution of data d102 from metadata d101 and terminal preferences d104, and a resolution conversion section 17 that performs spatial resolution conversion and color resolution conversion for data d102 in accordance with information generated by the terminal adaptive control section 15.

[0092] Next, user preferences d103 will be described. FIG. 2 is a detailed drawing of user preferences d103. As shown in FIG. 2, user preferences d103 are composed of a plurality of user preference descriptions 3 a to 3 n. In user preference descriptions 3 a to 3 n are stored a plurality of content identifiers 34 corresponding to each of user preference descriptions 3 a to 3 n, duration information 35 for displaying content at a desired time, and sets of keywords (user points of view) 36 a and 36 b for extracting a desired segment from content and priority levels 37 a and 37 b corresponding to these keywords 36 a and 36 b.

[0093] Next, a definition description of user preferences d103 including user preference descriptions 3 a to 3 n will be described in concrete terms. FIG. 3 is a drawing showing a definition description of user preferences d103.

[0094] As shown in FIG. 3, the user preference description definition 40 is written using DTD (Document Type Definition) of XML (extensible Markup Language).

[0095] The user preference description definition 40 defines there being at least one content item (Content) in the user preferences as indicated by reference numeral 41 in the drawing. Also, it is defined that there is at least one keyword (user point of view) 36 (Keyword) for each content item as indicated by reference numeral 42 in the drawing. Further, a content identifier 34 (ContentID), duration 35 (Duration), and screen size 46 (ScreenSize) which is size information for displaying data, are defined for the content as attributes as indicated by reference numeral 43 in the drawing. Also, the keyword 36 (Keyword) is defined as being written as text data as indicated by reference numeral 48 in the drawing. In addition, it is defined that there is a priority level 37 (Priority) as an attribute for each keyword 36.

[0096] Next, user preferences created using the user preference description definition shown in FIG. 3 will be described. FIG. 4 is a drawing showing an example of user preferences.

[0097] In FIG. 4, the item denoted by reference numeral 50 is an example of an actual user preference description written in XML using user preference description definition 40.

[0098] User preferences 50 include two contents 51 and 52. Content 51 has a content ID 53 a (in this example, 123456789), and content 52 has a content ID 53 b (in this example, 123456788). Also, content 51 includes a display duration 54 (in this example, smpte=00:05:00:00) as a content attribute.

[0099] In addition, content 51 includes keywords (user points of view) 55 a to 55 c. Nakata is entered for keyword 55 a, Soccer for keyword 55 b, and Japan for keyword 55 c. Also, as attributes of keywords 55 a to 55 c, priority level 5 is entered for keyword 55 a, priority level 4 for keyword 55 b, and priority level 2 for keyword 55 c.

[0100] Meanwhile, in content 52, a display scale 56 (in this example, pixel=320×240) is entered as a content attribute. In addition, content 52 includes keywords 55 d to 55 f. Headline is entered for keyword 55 d, Stock for keyword 55 e, and Sports for keyword 55 f. Also, as attributes of keywords 55 d to 55 f, priority level 5 is entered for keyword 55 d, priority level 5 for keyword 55 e, and priority level 3 for keyword 55 f.

[0101] Next, the configuration of the data d102 will be described using FIG. 5.

[0102] The data d102 is composed of a segment 61 that comprises the time range of the data d102. The segment 61 is composed of a first subsegment 62 and a second subsegment 63. Subsegment 62 is composed of a first subsegment 64 and a second subsegment 65, and subsegment 63 is composed of a first subsegment 66 and a subsegment 67. Thus, the data d102 has a hierarchical structure comprising segments and subsegments.

[0103] Keywords (segment points of view) 621 are added to subsegment 62, and keywords (segment points of view) 631 are added to subsegment 63. Also, keywords (segment points of view) 641 are added to subsegment 64, keywords (segment points of view) 651 are added to subsegment 65, keywords (segment points of view) 661 are added to subsegment 66, and keywords (segment points of view) 671 are added to subsegment 67.

[0104] Keywords 621, 631, 641, 651, 661, and 671 are entered in the metadata d101. Also, a plurality of keywords (KWD) indicating the contents of segments 62 to 67 corresponding to keywords 621, 631, 641, 651, 661, and 671 are assigned to keywords 621, 631, 641, 651, 661, and 671.

[0105] A segment priority (segment priority level) is assigned to each keyword (KWD). In the example in the drawing, keywords 621 are composed of a set of KWD#2 and segment priority level 3 which is the ranking within KWD#2, and a set of KWD#3 and segment priority level 3 which is the ranking within KWD#2.

[0106] Next, the operation of the segment selection section 16 and the operation of the user adaptive control section 14 will be described using FIG. 5 and FIG. 6. FIG. 5 is an operation explanation drawing that explains the operation of the segment selection section 16. FIG. 6 is a processing flowchart that explains the operation of the user adaptive control section 14.

[0107] The content data acquisition section 21 of the data adaptation section 12 reads and acquires metadata d101 and data d102 from the storage medium 11. Then, the user adaptive control section 14 analyzes the acquired metadata d101, extracts the data structure and at least one segment point of view to be added to each segment and the segment priority level at the segment point of view, and identifies the data (content) d102 that has been read (P701).

[0108] Next, the user adaptive control section 14 selects the user preference description (for example, user preference description 31) corresponding to the identified content from the user preferences d103 (P702). In addition, the user adaptive control section 14 arranges the user points of view (keywords) included in user preference description 31 in order of priority, which is a user point of view attribute (P703). The user adaptive control section 14 then selects the user point of view that has been assigned the highest priority level (P704).

[0109] Next, the user adaptive control section 14 sends information to the segment selection section 16 such that the segment that matches that user point of view is selected from the data d102, in order from the highest-priority user point of view (first user point of view).

[0110] The segment selection section 16 then compares the first user point of view with the segment points of view of the segments, using the information sent from the user adaptive control section 14, and judges whether there is a segment that has been assigned a segment point of view that matches the first user point of view (P705).

[0111] Next, a transition is made to the operation to select a segment that has been assigned a segment point of view that matches the first user point of view.

[0112] However, if all segments that have been assigned a segment point of view that matches the first user point of view are simply selected, it is possible that the selected segments may exceed the restriction conditions of the duration information 54 or spatial range information 56, or both of these. Thus, in this embodiment, all segments that have been assigned a segment point of view that matches the first user point of view are first provisionally selected, and then a number of segments that does not exceed the restriction conditions of the duration information 54 or spatial range information 56, or both of these, is actually selected from the provisionally selected segments.

[0113] To be specific, the segment selection section 16 first provisionally selects segments that conform to the user point of view (P706), then the segment selection section 16 judges whether provisional selection has been completed for all segments included in the metadata d101 (P707), and if it has not been completed, extracts the next segment using the metadata d101, and performs processing P705 and P706. In this way, provisional selection can be performed for all the segments included in the data d102.

[0114] Then, if the data adaptation section 12 judges in P707 that provisional selection has been completed for all the segments, the provisionally selected segments are arranged in the order of segment priority assigned to the segments (P708). This is done in order to make the actual selection of segments starting from the segment with the highest segment priority level in the actual segment selection process that will be described later.

[0115] First the data adaptation section 12 performs actual selection of the segment with the highest segment priority (P709). Next, the data adaptation section 12 judges whether actual selection has been completed for all provisionally selected segments (P710). Then, if the data adaptation section 12 judges in P710 that actual selection has not been completed for all provisionally selected segments, it judges whether the data length of the actually selected segments exceeds the restriction conditions of duration or spatial range, or both of these (P711). The data adaptation section 12 then repeats the operations from P709 to P711 as long as these restriction conditions are not exceeded.

[0116] If the data adaptation section 12 judges in P710 that actual selection has been completed for all provisionally selected segments, it judges whether processing has been performed for all user points of view (keywords) (P715). If the data adaptation section 12 judges in P715 that processing has been completed for all user points of view, it terminates processing. If, on the other hand, the data adaptation section 12 judges in P715 that processing has not been completed for all user points of view, a transition is made to processing for the next user point of view.

[0117] Here, performing processing and selection again for segments already selected in the above-described processing would be pointless. Therefore, the data adaptation section 12 first extracts unselected segments and performs the following processing on the unselected segments only (P714). The data adaptation section 12 then selects the next user point of view (P713) and performs processing P705 to P711.

[0118] The segment selection operation will now be described in concrete terms using FIG. 5. First, the data adaptation section 12 looks for a subsegment with KWD#1, which has the highest segment priority level of the user points of view (keywords) included in the user preferences (user preference description) 3. Keywords 631 of subsegment 63 and keywords 661 of subsegment 66 both have KWD#1. Next, the data adaptation section 12 adds a duration restriction to subsegment 63 and subsegment 66, and makes a selection from subsegment 63 and subsegment 66 in order of stringency of the duration restriction. To be specific, subsegment 66 for which the duration restriction is not stringent—that is, duration is short—is selected with top priority as output data d102 a. Then, subsegment 63 is selected as the segment making up output data 102 b.

[0119] Similarly, the data adaptation section 12 looks for a subsegment with KWD#2, which has the next-highest priority level of the user points of view included in the user preferences 3. KWD#2 is included in all the subsegments making up segment 61. Therefore, it is necessary here to decide which subsegment is to be given priority.

[0120] To be specific, the data adaptation section 12 compares the segment priority levels of the segment points of view added to each subsegment. In the example in FIG. 5, subsegment 63, subsegment 62, subsegment 65, and subsegment 66 have the same priority, followed in priority by subsegment 64 and subsegment 67. Since subsegment 67 has already been selected, it is omitted from the items subject to the following processing.

[0121] Therefore, after the data adaptation section 12 has selected output data d102 b, if further duration restrictions are permitted, subsegment 65, which has a higher segment priority level than subsegment 64, is selected in addition to subsegment 63 as a subsegment making up output data 102 c. The remaining subsegment 64 includes KWD#2 and KWD#3, and has a lower segment priority level than subsegment 65. Therefore, when duration restrictions are most lenient, subsegment 64 is selected in addition to subsegment 63 and subsegment 65 as a subsegment making up output data stream 102 d.

[0122] The user adaptive control section 14 updates the priority level of a user point of view included in user preferences d103 that coincides with a keyword according to the priority level of the keyword added to a selected segment.

[0123] In this way, it is possible to select segments suitable for user preferences d103 from data d102, and adapt data d102 to user preferences d103.

[0124] Next, the data adaptation section 12 shifts to an operation for converting the segments selected as described above according to the terminal preferences d104 that constitute terminal capability information. The operation of the terminal adaptive control section 15 will be described below using FIG. 7. FIG. 7 is a processing flowchart explaining the operation of the terminal adaptive control section 15.

[0125] First, the terminal adaptive control section 15 acquires the terminal preferences d104 to be recorded in the terminal 10, and identifies the screen display size and number of display colors of the display section 18 as terminal capabilities (P801). Next, the terminal adaptive control section 15 determines the segment priority level that the segment selected by the segment selection section 16 has as its own attribute (P802). Then the terminal adaptive control section 15 judges whether the selected segment is larger than the display capability of the display section 18 of the terminal 10 (P803).

[0126] If the terminal adaptive control section 15 judges in P803 that the selected segment is larger than the display capability of the display section 18 of the terminal 10, the terminal adaptive control section 15 adds a segment priority level to the terminal preferences d104, and determines whether to reduce the entire segment in size, display part of the selected segment, not display part of the selected segment, or convert part of the selected segment before displaying it (P804).

[0127] If, on the other hand, the terminal adaptive control section 15 judges in P803 that the selected segment is not larger than the display capability of the display section 18 of the terminal 10, the terminal adaptive control section 15 judges whether the data of the selected segment is smaller than the screen display size of the display section 18 (P805). If the terminal adaptive control section 15 judges in P805 that the data of the selected segment is smaller than the screen display size of the display section 18, the terminal adaptive control section 15 adds a segment priority to the terminal preferences d104, and determines whether to enlarge the entire segment, enlarge part of the selected segment, not display part of the selected segment, or convert part of the selected segment before displaying it (P806).

[0128] Next, the terminal adaptive control section 15 identifies the number of terminal display colors from the terminal preferences d104, and, in accordance with the number of terminal display colors, judges whether the segment for which processing P801 to P806 was executed is capable of color display by the display section 18 (P807). If the terminal adaptive control section 15 determines in P807 that the segment for which the above-described processing was executed is capable of color display by the display section 18, processing is terminated.

[0129] If, on the other hand, the terminal adaptive control section 15 determines in P807 that the segment for which the above-described processing was executed is not capable of color display by the display section 18, it is determined whether the segment for which the above-described processing was executed can be displayed by the display section 18 after gray-scale conversion (P808). Then, if the terminal adaptive control section 15 determines that the segment for which the above-described processing was executed is displayable by the display section 18 after gray-scale conversion, it is determined that the segment for which the above-described processing was executed is to be subjected to gray-scale conversion (P809). If the terminal adaptive control section 15 determines that the segment for which the above-described processing was executed is not displayable by the display section 18 after gray-scale conversion, it is determined that the segment for which the above-described processing was executed is to be subjected to binary conversion (P810).

[0130] The resolution conversion section 17 then adapts the contents of the decision by the terminal adaptive control section 15 for the actually selected segment and performs resolution conversion. Then the display section 18 displays the segment converted by the resolution conversion section 17.

[0131] As described above, according to Embodiment 1, one or more segment points of view added to segments in the metadata d101, and segment priority levels in the segment points of view, are extracted, and segment selection can be performed based on the segment priority of segments that have a segment point of view that matches a user point of view included in the user preferences d103. By this means, it is possible to perform data adaptation of data d102 fully in accordance with the user's preferences.

[0132] Also, according to Embodiment 1, it is possible to perform data adaptation fully in accordance with terminal capability by performing temporal and spatial resolution conversion of segments according to terminal capability information included in terminal preferences.

[0133] Moreover, according to Embodiment 1, the mode is such that a user priority level is assigned to each user point of view, and therefore relative user point of view priority levels can be changed by changing user priority levels alone. Consequently, editing of user points of view by the user is simplified.

Embodiment 2

[0134] A data adaptation apparatus according to Embodiment 2 of the present invention will be described below using FIG. 8. FIG. 8 shows a block diagram of a data adaptation apparatus according to Embodiment 2.

[0135] In Embodiment 2, the user adaptive control section according to Embodiment 1 is provided with a server, and the server and terminals are connected by a network. However, simply providing network connection of a user adaptive control section and terminals does not make it possible to perform data adaptation in a scalable fashion in the form the user wishes to receive and according to the status of the network. To solve this problem, in Embodiment 2, when distributing content to terminals via a network, the user adaptation section acquires information on the network transmission band as network preferences and adjusts the data quantity according to the segment priority and transmission band. In this way, Embodiment 2 enables data adaptation to be performed in a scalable fashion in the form the user wishes to receive and according to the status of the network.

[0136] Embodiment 2 will now be described in detail below. The configuration of a data adaptation section 22 according to Embodiment 2 will be described using FIG. 8. FIG. 8 is a block diagram of a system provided with a data adaptation apparatus 22 according to Embodiment 2.

[0137] As shown in FIG. 8, a server 20 and terminal 2B are connected by a network 2A. The terminal 2B is composed of a user preference storage section 30 that stores user preferences d103 which comprise information relating to the user's preferences, a terminal preference storage section 31 that stores terminal preferences d104 which comprise terminal 2B capability information, a network preference storage section 205 that stores network preferences d205 which comprise network 2A transmission band information, and a storage medium 2C that stores data sent from the server 20.

[0138] The server 20 is composed of a content data storage medium 21 on which is stored data d102 consisting of content composed of a plurality of segments and metadata d101 which is information for describing the data d102, and a user adaptation section 22 that adapts the data d102 to the user's preferences using the metadata d101, user preferences d103, terminal preferences d104, and network preferences d205.

[0139] The user adaptation section 22 is provided with means for acquiring various kinds of data. Provided as means for acquiring various kinds of data are a content data acquisition section 33 consisting of a metadata acquisition section 33 a that acquires metadata d101 and a data acquisition section 33 b that acquires data d102, a user preference acquisition section 34 that acquires user preferences d103 via the network 2A, a terminal preference acquisition section 35 that acquires terminal preferences d104 via the network 2A, and a network preference acquisition section 36 that acquires network preferences d205 via the network 2A.

[0140] In addition, the user adaptation section 12 is provided with means for selecting a predetermined segment from the data d102 acquired in accordance with the user's preferences and adapting it to the user's preferences. Provided as means for adapting a selected segment to the user's preferences are a user adaptive control section 24 that generates information for selecting a predetermined segment from acquired data d102 using acquired metadata d101 and user preference data d103, and a segment selection section 26 that selects and extracts a predetermined segment from acquired data d102 on the basis of information generated by the user adaptive control section 24.

[0141] Moreover, the user adaptation section 24 is provided with means for converting data d102 in accordance with the capability of the terminal 2B which is a data d102 processing apparatus. Provided as means for converting data d102 in accordance with the terminal capability are a terminal adaptive control section 25 that generates information for varying the spatial resolution and color resolution of data d102 from metadata d101 and terminal preferences d104, a resolution conversion section 27 that performs spatial resolution conversion and color resolution conversion for d102 in accordance with information generated by the terminal adaptive control section 25, a network adaptive control section 28 that generates information for adjusting the quantity of data d102 sent to the network 2A using the metadata d101 and network preferences d205, and a data quantity adjustment section 29 that adjusts the quantity of data sent to the network 2A according to information generated by the network adaptive control section 28.

[0142] Next, the operation of the segment selection section 26 and the operation of the user adaptive control section 24 will be described using FIG. 6.

[0143] The content data acquisition section 33 of the data adaptation section 24 reads and acquires metadata d101 and data d102 from the storage medium 21. Then, the user adaptive control section 24 analyzes the acquired metadata d101, extracts the data structure and at least one segment point of view to be added to each segment and the segment priority level at the segment point of view, and identifies the data (content) d102 that has been read (P701). Next, the user adaptive control section 24 selects the user preference description (for example, user preference description 31) corresponding to the identified content from the user preferences d103 (P702). In addition, the user adaptive control section 24 arranges the user points of view (keywords) included in user preference description 31 in order of priority level, which is a user point of view attribute (P703). The user point of view that has been assigned the highest priority level is then selected (P704).

[0144] Next, the user adaptive control section 24 sends information to the segment selection section 26 such that a segment that matches that user point of view is selected from the data d102, in order from the highest-priority user point of view (first user point of view).

[0145] The segment selection section 26 then compares the first user point of view with the segment points of view of the segments, using the information sent from the user adaptive control section 24, and judges whether there is a segment that has been assigned a segment point of view that matches the first user point of view (P705).

[0146] Next, a transition is made to the operation to select a segment that has been assigned a segment point of view that matches the first user point of view.

[0147] The segment selection section 26 first provisionally selects segments that conform to the user point of view (P706). Then the segment selection section 26 judges whether provisional selection has been completed for all segments included in the metadata d101 (P707), and if it has not been completed, extracts the next segment using the metadata d101, and performs processing P705 and P706. In this way, provisional selection can be performed for all the segments included in the data d102.

[0148] Then, if the data adaptation section 22 judges in P707 that provisional selection has been completed for all the segments, the provisionally selected segments are arranged in the order of segment priority assigned to the segments (P708). This is done in order to make the actual selection of segments starting from the segment with the highest segment priority level in the actual segment selection process that will be described later.

[0149] First, the data adaptation section 22 performs actual selection of the segment with the highest segment priority level (P709). Next, the data adaptation section 22 judges whether actual selection has been completed for all provisionally selected segments (P710). Then, if the data adaptation section 22 judges in P710 that actual selection has not been completed for all provisionally selected segments, it judges whether the data length of the actually selected segments exceeds the restriction conditions of duration or spatial range, or both of these (P711). The data adaptation section 22 then repeats the operations from P709 to P711 as long as these restriction conditions are not exceeded.

[0150] If the data adaptation section 22 judges in P710 that actual selection has been completed for all provisionally selected segments, it judges whether processing has been performed for all user points of view (keywords) (P715). If the data adaptation section 22 judges in P715 that processing has been completed for all user points of view (keywords), it terminates processing. If, on the other hand, the data adaptation section 22 judges in P715 that processing has not been completed for all user points of view, a transition is made to processing for the next user point of view.

[0151] Here, performing processing and selection again for segments already selected in the above-described processing would be pointless. Therefore, the data adaptation section 22 first extracts unselected segments and performs the following processing on the unselected segments only (P714). It then selects the next user point of view (P713) and performs processing P705 to P711.

[0152] In this way, it is possible to select segments suitable for user preferences d103 from data d102, and adapt data d102 to user preferences d103.

[0153] Next, the data adaptation section 12 shifts to an operation for converting the segments selected as described above according to the terminal preferences d104 that constitute terminal capability information. The operation of the terminal adaptive control section 25 will be described below using FIG. 7.

[0154] First, the terminal adaptive control section 25 acquires the terminal preferences d104 to be recorded in the terminal 2B from the terminal preference acquisition section 35, and identifies the screen display size and number of display colors of the display section 18 as terminal capabilities (P801). Next, the terminal adaptive control section 55 determines the segment priority level that the segment selected by the segment selection section 26 has as its own attribute (P802). Then the terminal adaptive control section 25 judges whether the selected segment is larger than the display capability of the display section 18 of the terminal 2B (P803).

[0155] If the terminal adaptive control section 25 judges in P803 that the selected segment is larger than the display capability of the terminal 2B, the terminal adaptive control section 25 adds a segment priority level to the terminal preferences d104, and determines whether to reduce the entire segment in size, display part of the selected segment, not display part of the selected segment, or convert part of the selected segment before displaying it (P804).

[0156] If, on the other hand, the terminal adaptive control section 25 judges in P803 that the selected segment is not larger than the display capability of the terminal 2B, the terminal adaptive control section 25 judges whether the data of the selected segment is smaller than the screen display size of the terminal 2B (P805). If the terminal adaptive control section 25 judges in P805 that the data of the selected segment is smaller than the screen display size of the terminal 2B, the terminal adaptive control section 25 adds a segment priority level to the terminal preferences d104, and determines whether to enlarge the entire segment, enlarge part of the selected segment, not display part of the selected segment, or convert part of the selected segment before displaying it (P806).

[0157] Next, the terminal adaptive control section 25 identifies the number of terminal 2B display colors from the terminal preferences d104, and, in accordance with the number of terminal display colors, judges whether the segment for which processing P801 to P806 was executed is capable of color display by the display section (P807). If the terminal adaptive control section 25 determines in P807 that the segment for which the above-described processing was executed is capable of color display by the terminal 2B, processing is terminated.

[0158] If, on the other hand, the terminal adaptive control section 25 determines in P807 that the segment for which the above-described processing was executed is not capable of color display by the terminal 2B, it is determined whether the segment for which the above-described processing was executed can be displayed by the terminal 2B after gray-scale conversion (P808). Then, if the terminal adaptive control section 25 determines that the segment for which the above-described processing was executed is displayable by the display section 18 after gray-scale conversion, it is determined that the segment for which the above-described processing was executed is to be subjected to gray-scale conversion (P809). If the terminal adaptive control section 25 determines that the segment for which the above-described processing was executed is not displayable by the terminal 2B after gray-scale conversion, it is determined that the segment for which the above-described processing was executed is to be subjected to binary conversion (P810).

[0159] The resolution conversion section 27 then adapts the contents of the decision by the terminal adaptive control section 25 for the actually selected segment and performs resolution conversion. Then the data subjected to resolution conversion is sent to the data quantity adjustment section 29.

[0160] Next, the operation of the network adaptive control section 28 will be described using FIG. 9. FIG. 9 is a processing flowchart of the network adaptive control section 28 according to Embodiment 2.

[0161] The network adaptive control section 28 acquires from the network preference acquisition section 36 network preferences d205 sent from the terminal 2B via the network 2A. Then the network adaptive control section 28 identifies the transmission band of the network 2A (P901). Next, the network adaptive control section 28 determines the segment priority level that the segment selected by the segment selection section 26 has as its own attribute (P902). The network adaptive control section 28 then judges whether the converted data is larger than the transmission band (P903).

[0162] If the network adaptive control section 28 judges in P903 that the converted data is larger than the transmission band, the network adaptive control section 28 determines whether to compress all the data, transmit part of the data, not transmit all the data, or convert part of the data before transmitting it (P904). Here, converting the data before transmitting it refers to format conversion such as converting MPEG1 data to MPEG4 data or converting AAC data to MP3 data.

[0163] If, on the other hand, the network adaptive control section 28 judges in P903 that the converted data is not larger than the transmission band, the network adaptive control section 28 judges whether the converted segment data is smaller than the transmission band (P905). If the network adaptive control section 28 judges in P905 that the converted data is smaller than the transmission band, the network adaptive control section 28 determines whether to perform additional transmission of untransmitted data, not transmit, or transmit after converting or restoring conversion to its original state (P906).

[0164] The data quantity adjustment section 29 then adapts the contents of the decision by the network adaptive control section 28 for the actually selected segment, adjusts the data quantity, and transmits it to the terminal 2B. The terminal 2B records the received segment in the storage medium 2C.

[0165] As described above, according to Embodiment 2, in addition to the effects of Embodiment 1, by adjusting the selected segment data quantity according to the transmission band included in the network preferences d205, it is possible to perform data adaptation in a scalable fashion in the form the user wishes to receive and in accordance with the status of the network.

Embodiment 3

[0166] A data adaptation apparatus according to Embodiment 3 of the present invention will now be described below. The configuration of the data adaptation apparatus according to Embodiment 3 is identical to the configuration of the data adaptation apparatus according to Embodiment 1, and therefore a description of the configuration of the data adaptation apparatus according to Embodiment 3 will be omitted.

[0167] The data adaptation apparatus according to Embodiment 3 and the data adaptation apparatus according to Embodiment 1 differ in the configuration of the user preferences d103. The user preferences d103 according to Embodiment 3 will be described below. FIG. 10 is a second detailed drawing of user preferences d103.

[0168] As shown in FIG. 10, user preferences d103 are composed of a plurality of user preference descriptions 131 to 133. In user preference descriptions 131 to 133 are stored a plurality of content identifiers 134 corresponding to each of user preference descriptions 131 to 133, duration information 135 for displaying content, and keywords 136 a and 136 b for extracting a predetermined segment from content. Thus, priority levels corresponding to keywords 136 a and 136 b are not stored in the user preferences of Embodiment 3. This is a point of difference between the user preferences of Embodiment 3 and the user preferences of Embodiment 1.

[0169] Next, a definition description of user preferences d103 including user preference descriptions 131 to 133 will be described in concrete terms. FIG. 11 is a drawing showing a definition description of user preferences d103.

[0170] As shown in FIG. 11, the user preference description definition 140 is written using DTD (Document Type Definition) of XML (extensible Markup Language).

[0171] The user preference description definition 140 defines there being at least one content (Content) in the user preferences as indicated by reference numeral 141 in the drawing. Also, it is defined that there is at least one keyword 136 (Keyword) for each content as indicated by reference numeral 142 in the drawing. Further, a content identifier 134 (ContentID), duration 135 (Duration), and screen size 144 (ScreenSize) which is size information for displaying data, are defined for the content as attributes as indicated by reference numeral 143 in the drawing. Also, the keyword 136 (Keyword) is defined as being written as text data as indicated by reference numeral 148 in the drawing.

[0172] It can also be see from the user preference description definition 140 in FIG. 11 that a priority level corresponding to the keyword 136 is not stored in the user preferences of Embodiment 3.

[0173] Next, user preferences created using the user preference description definition shown in FIG. 11 will be described. FIG. 12 is a drawing showing an example of user preferences.

[0174] In FIG. 12, reference numeral 150 denotes an example of an actual user preference description written in XML using user preference description definition 40.

[0175] User preferences 150 shown in FIG. 12 include two content entities 151 and 152. Content 151 has a content ID 153 a (in this example, 123456789), and content 152 has a content ID 153 b (in this example, 123456788). Also, content 151 includes a display duration 154 (in this example, smpte=00:05:00:00) as a content attribute. In addition, content 151 includes keywords 155 a to 155 c. Nakata is entered for keyword 155 a, Soccer for keyword 155 b, and Japan for keyword 155 c.

[0176] Meanwhile, in content 152, a display scale 156 (in this example, pixel=320×240) is entered as a content attribute. In addition, content 152 includes keywords 155 d to 155 f. Headline is entered for keyword 155 d, Stock for keyword 155 e, and Sports for keyword 155 f.

[0177] Next, the configuration of data d102 according to Embodiment 3 will be described using FIG. 13. FIG. 13 is an operation explanation drawing explaining the operation of the segment selection section 16. In FIG. 13, the item denoted by reference number 131 is a user preference description. Apart from the user preference description 131, the configuration is similar to that of Embodiment 1.

[0178] Next, the operation of the segment selection section 16 and the operation of the user adaptive control section 14 will be described using FIG. 13 and FIG. 14. FIG. 13 is an operation explanation drawing that explains the operation of the segment selection section 16. FIG. 14 is a processing flowchart that explains the operation of the user adaptive control section 14.

[0179] The content data acquisition section 21 of the data adaptation section 12 reads and acquires metadata d101 and data d102 from the storage medium 11. Then, the user adaptive control section 14 analyzes the acquired metadata d101, extracts the data structure and at least one segment point of view to be added to each segment and the segment priority level at the segment point of view, and identifies the data (content) d102 that has been read (P1701). Next, the user adaptive control section 14 selects the user preference description (for example, user preference description 131) corresponding to the identified content from the user preferences d103 (P1702). In addition, the user adaptive control section 14 arranges the user points of view (keywords) included in user preference description 131 in the order in which they are written. In the example in FIG. 12, the keywords are arranged in order starting from the keyword written in the top line—that is, in the order keyword 155 a, keyword 155 b, keyword 155 c. Then the first user point of view—that is, the one written at the top—is selected (P1704). The reason for arranging the keywords in the order in which they are written in this way is that, since user priority levels are not assigned to user preferences d103 according to Embodiment 3, it is necessary to assign some kind of priority levels corresponding to user priorities. In Embodiment 3, the keyword priority levels are made to correspond to the order in which they are written, as a substitute for user priority levels.

[0180] Next, the user adaptive control section 14 sends information to the segment selection section 16 such that a segment that matches that user point of view is selected from the data d102, in order from the highest-priority user point of view (first user point of view).

[0181] The segment selection section 16 then compares the first user point of view with the segment points of view of the segments, using the information sent from the user adaptive control section 14, and judges whether there is a segment that has been assigned a segment point of view that matches the first user point of view (P1705).

[0182] Next, a transition is made to the operation to select a segment that has been assigned a segment point of view that matches the first user point of view.

[0183] The segment selection section 16 first provisionally selects segments that conform to the user point of view (P1706). Then the segment selection section 16 judges whether provisional selection has been completed for all segments included in the data d102 (P1707), and if it has not been completed, extracts the next segment using the metadata d101, and performs processing P1705 and P1706. In this way, provisional selection can be performed for all the segments included in the data d102.

[0184] Then, if the data adaptation section 12 judges in P1707 that provisional selection has been completed for all the segments, the provisionally selected segments are arranged in the order of segment priority assigned to the segments (P1708). This is done in order to make the actual selection of segments starting from the segment with the highest segment priority level in the actual segment selection process that will be described later.

[0185] First the data adaptation section 12 performs actual selection of the segment with the highest segment priority level (P1709). Next, the data adaptation section 12 judges whether actual selection has been completed for all provisionally selected segments (P1710). Then, if the data adaptation section 12 judges in P1710 that actual selection has not been completed for all provisionally selected segments, it judges whether the data length of the actually selected segments exceeds the restriction conditions of duration or spatial range, or both of these (P1711). The data adaptation section 12 then repeats the operations from P1709 to P1711 as long as these restriction conditions are not exceeded.

[0186] If the data adaptation section 12 judges in P1710 that actual selection has been completed for all provisionally selected segments, it judges whether processing has been performed for all user points of view (keywords) (P1715). If the data adaptation section 12 judges in P1715 that processing has been completed for all user points of view, it terminates processing. If, on the other hand, the data adaptation section 12 judges in P1715 that processing has not been completed for all user points of view, a transition is made to processing for the next user point of view.

[0187] Here, performing processing and selection again for segments already selected in the above-described processing would be pointless. Therefore, the data adaptation section 12 first extracts unselected segments and performs the following processing on the unselected segments only (P1714). The data adaptation section 12 then selects the next user point of view (P1713) and performs processing P1705 to P1711.

[0188] The segment selection operation will now be described in concrete terms using FIG. 13. First, the data adaptation section 12 looks for a subsegment written in the top line—that is with high-priority KWD#1—within the user points of view (user keywords) included in the user preferences (user preference description) 131. Keywords 631 of subsegment 63 and keywords 661 of subsegment 66 both have KWD#1. Next, the data adaptation section 12 adds a duration restriction to subsegment 63 and subsegment 66, and makes a selection from subsegment 63 and subsegment 66 in order of stringency of the duration restriction. To be specific, subsegment 66 for which the duration restriction is not stringent—that is, duration is short—is selected with top priority as output data d102 a. Then, subsegment 63 is selected as the segment making up output data 102 b.

[0189] Similarly, the data adaptation section 12 looks for a subsegment with KWD#2, which has the next-highest priority of the user points of view included in the user preferences d103. KWD#2 is included in all the subsegments making up segment 61. Therefore, it is necessary here to decide which subsegment is to be given priority.

[0190] To be specific, the data adaptation section 12 compares the segment priority levels of the segment points of view added to each subsegment. In the example in FIG. 13, subsegment 63, subsegment 62, subsegment 65, and subsegment 66 have the same priority level, followed in priority by subsegment 64 and subsegment 67. Since subsegment 67 has already been selected, it is omitted from the items subject to the following processing.

[0191] Therefore, after the data adaptation section 12 has selected output data d102 b, if further duration restrictions are permitted, subsegment 65, which has a higher segment priority level than subsegment 64, is selected in addition to subsegment 63 as a subsegment making up output data 102 c. The remaining subsegment 64 includes KWD#2 and KWD#3, and has a lower segment priority level than subsegment 65, so when duration restrictions are most lenient, subsegment 64 is selected in addition to subsegment 63 and subsegment 65 as a subsegment making up output data stream 102 d.

[0192] The user adaptive control section 14 updates the priority level of a user point of view included in user preferences d103 that coincides with a keyword according to the priority level of the keyword added to a selected segment.

[0193] In this way, it is possible to select segments suitable for user preferences d103 from data d102, and adapt data d102 to user preferences d103.

[0194] Next, as in Embodiment 1, the terminal adaptive control section 15 performs resolution conversion of the selected segment sent from the segment selection section 16 in accordance with the flowchart shown in FIG. 7.

[0195] As described above, according to Embodiment 3, it is possible to perform processing using the order in which user points of view are written for user point of view priority levels, without assigning user priority levels to the user preferences d103. By this means, it is possible to perform data adaptation fully in accordance with the user's preferences in the same way as with Embodiment 1, without assigning user priority levels to the user preferences d103.

[0196] Moreover, not providing user priority levels, as in Embodiment 3, simplifies the data structure of the user preferences d103.

Embodiment 4

[0197] A data adaptation apparatus according to Embodiment 4 of the present invention will now be described below. In Embodiment 4, the user adaptive control section in Embodiment 3 is provided in a server, and the server and terminals are connected by a network.

[0198] The system that includes a data adaptation apparatus according to Embodiment 4 has the same configuration as a system that includes a data adaptation apparatus according to Embodiment 2. Therefore, FIG. 8 is a block diagram of a system that includes a data adaptation apparatus according to Embodiment 4.

[0199] The user preferences d103 according to Embodiment 4 are the same as in Embodiment 3. Therefore, the drawing shown in FIG. 10 is a drawing showing the user preferences d103 according to Embodiment 4. Also, FIG. 11 shows a definition of user preferences according to Embodiment 4.

[0200] The operation of the segment selection section 26 according to Embodiment 4 is identical to that of the segment selection section 26 according to Embodiment 3. Therefore, FIG. 13 is an operation explanation drawing that explains the operation of the segment selection section 26. In addition, FIG. 14 is a processing flowchart that explains the operation of the user adaptive control section 24 according to Embodiment 4.

[0201] Moreover, the operation of the terminal adaptive control section 25 according to Embodiment 4 is identical to that of the terminal adaptive control section according to Embodiment 3. Therefore, FIG. 7 is a processing flowchart explaining the operation of the terminal adaptive control section 25 according to Embodiment 4. Also, the operation of the network adaptive control section 28 according to Embodiment 4 is identical to that of the network adaptive control section 28 according to Embodiment 2. Therefore, FIG. 9 is a processing flowchart explaining the operation of the network adaptive control section 28 according to Embodiment 4.

[0202] A system including a data adaptation apparatus according to Embodiment 4 will be described below using these attached drawings.

[0203] The content data acquisition section 33 of the data adaptation section 22 reads and acquires metadata d101 and data d102 from the storage medium 21. Then, the user adaptive control section 24 analyzes the acquired metadata d101, extracts the data structure and at least one segment point of view to be added to each segment and the segment priority level at the segment point of view, and identifies the data (content) d102 that has been read (P1701). Next, the user adaptive control section 24 selects the user preference description (for example, user preference description 131) corresponding to the identified content from the user preferences d103 (P1702). In addition, the user adaptive control section 24 arranges the user points of view (keywords) included in user preference description 131 in the order in which they are written. In the example in FIG. 12, the keywords are arranged in order starting from the keyword written in the top line—that is, in the order keyword 155 a, keyword 155 b, keyword 155 c. Then the first user point of view—that is, the one written at the top—is selected (P1704). The reason for arranging the keywords in the order in which they are written in this way is that, since user priorities are not assigned to user preferences d103 according to Embodiment 4, it is necessary to assign some kind of priority levels corresponding to user priorities. In Embodiment 3, the keyword priority levels are set in the order in which they are written, as a substitute for user priorities.

[0204] Next, the user adaptive control section 24 sends information to the segment selection section 26 such that a segment that matches that user point of view is selected from the data d102, in order from the highest-priority user point of view (first user point of view).

[0205] The segment selection section 26 then compares the first user point of view with the segment points of view of the segments, using the information sent from the user adaptive control section 24, and judges whether there is a segment that has been assigned a segment point of view that matches the first user point of view (P1705).

[0206] Next, a transition is made to the operation to select a segment that has been assigned a segment point of view that matches the first user point of view.

[0207] The segment selection section 26 first provisionally selects segments that conform to the user point of view (P1706). Then the segment selection section 26 judges whether provisional selection has been completed for all segments included in the metadata d101 (P1707), and if it has not been completed, extracts the next segment using the metadata d101, and performs processing P1705 and P1706. In this way, provisional selection can be performed for all the segments included in the data d102.

[0208] Then, if the data adaptation section 22 judges in P1707 that provisional selection has been completed for all the segments, the provisionally selected segments are arranged in the order of segment priority assigned to the segments (P1708). This is done in order to make the actual selection of segments starting from the segment with the highest segment priority level in the actual segment selection process that will be described later.

[0209] First the data adaptation section 22 performs actual selection of the segment with the highest segment priority level (P1709). Next, the data adaptation section 22 judges whether actual selection has been completed for all provisionally selected segments (P1710). Then, if the data adaptation section 22 judges in P1710 that actual selection has not been completed for all provisionally selected segments, it judges whether the data length of the actually selected segments exceeds the restriction conditions of duration or spatial range, or both of these (P1711). The data adaptation section 22 then repeats the operations from P1709 to P1711 as long as these restriction conditions are not exceeded.

[0210] If the data adaptation section 22 judges in P1710 that actual selection has been completed for all provisionally selected segments, it judges whether processing has been performed for all user points of view (keywords) (P1715). If the data adaptation section 22 judges in P1715 that processing has been completed for all user points of view, it terminates processing. If, on the other hand, the data adaptation section 22 judges in P1715 that processing has not been completed for all user points of view, a transition is made to processing for the next user point of view.

[0211] Here, performing processing and selection again for segments already selected in the above-described processing would be pointless. Therefore, the data adaptation section 22 first extracts unselected segments and performs the following processing on the unselected segments only (P1714). The data adaptation section 22 then selects the next user point of view (P1713) and performs processing P1705 to P1711.

[0212] The segment selection operation will now be described in concrete terms using FIG. 13. First, the data adaptation section 22 looks for a subsegment written in the top line—that is with high-priority KWD#1—within the user points of view (user keywords) included in the user preferences (user preference description) 131. Keywords 631 of subsegment 63 and keywords 661 of subsegment 66 both have KWD#1. Next, the data adaptation section 22 adds a duration restriction to subsegment 63 and subsegment 66, and makes a selection from subsegment 63 and subsegment 66 in order of stringency of the duration restriction.

[0213] To be specific,subsegment 66 for which the duration restriction is not stringent—that is, duration is short—is selected with top priority as output data d102 a. Then, subsegment 63 is selected as the segment making up output data 102 b.

[0214] Similarly, the data adaptation section 22 looks for a subsegment with KWD#2, which has the next-highest priority of the user points of view included in the user preferences d103. KWD#2 is included in all the subsegments making up segment 61. Therefore, it is necessary here to decide which subsegment is to be given priority.

[0215] To be specific, the data adaptation section 22 compares the segment priority levels of the segment points of view added to each subsegment. In the example in FIG. 13, subsegment 63, subsegment 62, subsegment 65, and subsegment 66 have the same priority level, followed in priority by subsegment 64 and subsegment 67. Since subsegment 67 has already been selected, it is omitted from the items subject to the following processing.

[0216] Therefore, after the data adaptation section 12 has selected output data d102 b, if further duration restrictions are permitted, subsegment 65, which has a higher segment priority level than subsegment 64, is selected in addition to subsegment 63 as a subsegment making up output data 102 c. The remaining subsegment 64 includes KWD#2 and KWD#3, and has a lower segment priority level than subsegment 65, so when duration restrictions are most lenient, subsegment 64 is selected in addition to subsegment 63 and subsegment 65 as a subsegment making up output data stream 102 d.

[0217] The user adaptive control section 24 updates the priority level of a user point of view included in user preferences d103 that coincides with a keyword according to the priority level of the keyword added to a selected segment.

[0218] In this way, it is possible to select segments suitable for user preferences d103 from data d102, and adapt data d102 to user preferences d103.

[0219] Next, as in Embodiment 1, the terminal adaptive control section 25 performs resolution conversion of the selected segment sent from the segment selection section 26 in accordance with the flowchart shown in FIG. 7.

[0220] Next, the operation of the network adaptive control section 28 will be described using FIG. 9. FIG. 9 is a processing flowchart of the network adaptive control section 28 according to Embodiment 4.

[0221] The network adaptive control section 28 acquires from the network preference acquisition section 36 network preferences d205 sent from the terminal 2B via the network 2A. Then the network adaptive control section 28 identifies the transmission band of the network 2A (P901). Next, the network adaptive control section 28 determines the segment priority level that the segment selected by the segment selection section 26 has as its own attribute (P902). The network adaptive control section 28 then judges whether the converted data is larger than the transmission band (P903).

[0222] If the network adaptive control section 28 judges in P903 that the converted data is larger than the transmission band, the network adaptive control section 28 determines whether to compress all the data, transmit part of the data, not transmit all the data, or convert part of the data before transmitting it (P904).

[0223] If, on the other hand, the network adaptive control section 28 judges in P903 that the converted data is not larger than the transmission band, the network adaptive control section 28 judges whether the converted segment data is smaller than the transmission band (P905). If the network adaptive control section 28 judges in P905 that the converted data is smaller than the transmission band, the network adaptive control section 28 determines whether to perform additional transmission of untransmitted data, not transmit, or transmit after converting or restoring conversion to its original state (P906).

[0224] The data quantity adjustment section 29 then adapts the contents of the decision by the network adaptive control section 28 for the actually selected segment, adjusts the data quantity, and transmits it to the terminal 2B. The terminal 2B records the received segment in the storage medium 2C.

[0225] As described above, according to Embodiment 4, by extracting the data structure and at least one point of view to be added to each segment of the structure and the segment priority level at the segment point of view, performing segment selection based on the priority of a point of view that coincides with a user point of view included in user preferences, performing temporal and spatial resolution conversion of selected segments according to terminal capability information included in terminal preferences, and adjusting the selected segment data quantity according to the transmission band included in network preferences, it is possible to perform data adaptation in a scalable fashion in a form the user wishes to receive and in accordance with the status of the network.

[0226] In Embodiment 3 and Embodiment 4, user point of view priority levels follow the order of description, but the priority level of each user point of view may also be represented by another description method, such as reversing that order, or making an item located in the middle of the description order the highest-level item.

[0227] Also, in Embodiment 2 and Embodiment 4, a mode is described whereby a user adaptive control section 24, terminal adaptive control section 25, and network adaptive control section 28, which are control means, are provided on the server 20 side as shown in FIG. 8, but a mode is also possible whereby a user adaptive control section 24, terminal adaptive control section 25, and network adaptive control section 28 are provided in a terminal 2B.

[0228] In the case of this mode, metadata d102 is sent from the server 20 to the terminal 2B, data d102 is subjected to user adaptation by the terminal adaptive control section 25 in the terminal 2B, and the result is sent to the server 20. The server 20 then selects a segment from the data d102 based on information sent from the terminal adaptive control section 25, and transmits the selected segment to the terminal 2B. A signal that controls the resolution conversion section 27 of the server 20 is sent from the terminal adaptive control section 25 of the terminal 2B, and a signal that controls the data quantity adjustment section 29 of the server 20 is sent from the network adaptive control section 28 of the terminal 2B. The resolution conversion section 27 and data quantity adjustment section 29 operate in accordance with control signals sent from the terminal 2B, and the segment selection section 26 processes the selected data and sends the processed segment to the storage medium 2C of the terminal 2B.

[0229] Also, in the above-described sample embodiments, a mode is described whereby one segment point of view is assigned to a segment or subsegment. However, a mode is also possible whereby, if there is a plurality of segments or subsegments to which the same segment point of view has been assigned, a segment point of view is added to one of the segments or subsegments, and link information for that segment point of view is assigned to the other segments or subsegments.

[0230] By this means it is possible to represent the segment point of view of a segment or subsegment by a link to the segment point of view of another segment or subsegment.

[0231] This mode will be described in detail below using FIG. 16 and FIG. 17. FIG. 16 is a drawing showing another mode of segments according to an embodiment of the present invention. FIG. 17 is a drawing showing examples of segment descriptions according to an embodiment of the present invention.

[0232] As can be seen from FIG. 16, segment 1601 is a segment that has the structure already described in Embodiment 1 to Embodiment 4. Segment 1601 is assigned a segment point of view and a segment priority level.

[0233] Segment 1602 and segment 1603 are assigned the same segment point of view. Segment 1603 is assigned link information for segment 1602, and is linked to segment 1602.

[0234] Segment 1602 and segment 1603 will now be described in detail using FIG. 17.

[0235] Segment 1602 contains a segment point of view (keyword) ID number (id) 1701. In this example, the ID number 1701 is 1. Segment 1602 also contains a segment priority level (P) 1702 corresponding to the keyword. In this example, the segment priority level is 5. Also, “TeamA” is entered as a keyword in segment 1602.

[0236] Segment 1603 contains a reference number (idref) 1703 for another segment point of view (keyword) which is link information. In this example, the reference number 1701 is 1. That is to say, segment 1603 references a keyword whose ID number is 1.

[0237] Thus, the keyword of segment 1603 is “TeamA”. Segment 1603 contains a segment priority level (P) 1704 corresponding to the keyword. In this example, the segment priority level is 2.

[0238] Linking segment keywords in this way makes it unnecessary to enter keywords for all segments. In addition, linking segment keywords makes explicit the relationship between segments.

Embodiment 5

[0239] A data adaptation apparatus according to Embodiment 5 of the present invention will now be described below. The system configuration of Embodiment 5 is the same as that of Embodiment 1to Embodiment 4.

[0240] In Embodiment 5, with regard to segment points of view added to segments or subsegments, a table summarizing all segment points of view to be registered (point of view table) is provided as a content sub-element which is an element of the top level of context structure description data.

[0241] Next, the data structure according to Embodiment 5 will be described using FIG. 18 and FIG. 19. FIG. 18 is a drawing showing the data structure according to Embodiment 5. FIG. 19 is a drawing showing an example of data descriptions according to Embodiment 5.

[0242] As can be seen from FIG. 18, content has a point of view table 1801 as a sub-element. In the point of view table 1801 are stored a plurality of segment points of view 1802 a to 1802 n included in the content.

[0243] Also, the content includes a plurality of segments 1803 to 1805. Segment 1803 is assigned link information for the point of view table 1801, and is linked to segment point of view 1802 a of the point of view table 1801. Segment 1804 is assigned link information for the point of view table 1801, and is linked to segment point of view 1802 b of the point of view table 1801. Segment 1804 is assigned link information for the point of view table 1801, and is linked to segment point of view 1802 c of the point of view table 1801. Also, segments 1803 to 1805 are assigned segment priority levels corresponding to the respective segment points of view.

[0244] Next, the data structure according to Embodiment 5 will be described in detail using FIG. 19.

[0245] The point of view table 1801 contains segment points of view 1802 a to 1802 c. Segment point of view 1802 a contains an ID number (id) 1901 a. In this example, ID number 1901 a is 1. Also, segment point of view 1802 a is indicated by the text “A”.

[0246] Segment point of view 1802 b contains an ID number (id) 1901 b. In this example, ID number 1901 b is 2. Also, segment point of view 1802 b is indicated by the text “B”. Segment point of view 1802 c contains an ID number (id) 1901 c. In this example, ID number 1901 c is 3. Also, segment point of view 1802 c is indicated by the text “C”.

[0247] Meanwhile, segments 1803 to 1805 contain reference numbers (idref) 1903 a to 1903 c, respectively, which are link information for segment points of view 1802 a to 1802 c of the point of view table 1801.

[0248] In this example, reference number 1903 a of segment 1803 is 1. That is to say, segment 1803 references user point of view 1802 a whose ID number is 1. Therefore, the keyword of segment 1803 is “A”. Segment 1803 also contains a segment priority level (P) 1904 a corresponding to the keyword. In this example, the segment priority level is 2. Also, reference number 1903 b of segment 1804 is 2. That is to say, segment 1804 references user point of view 1802 b whose ID number is 2. Therefore, the keyword of segment 1804 is “B”.

[0249] Segment 1804 also contains a segment priority level (P) 1904 b corresponding to the keyword. In this example, the segment priority level is 3. Also, reference number 1903 c of segment 1805 is 3. That is to say, segment 1805 references user point of view 1802 c whose ID number is 3. Therefore, the keyword of segment 1805 is “C”. Segment 1805 also contains a segment priority level (P) 1904 c corresponding to the keyword. In this example, the segment priority level is 4.

[0250] Using this kind of configuration makes it easy to present a segment point of view list to the user in advance. By this means, the user can ascertain the segment points of view that appear there before inputting a desired segment point of view. Also, segment point of view input by the user can be carried out by making a selection from the point of view table.

[0251] A configuration may also be used whereby a pair comprising a link to a corresponding point of view in this point of view table and a corresponding score are added to each segment or subsegment.

[0252] Also, the point of view table may have a configuration for provision to a certain segment or subsegment rather than content, and may use a special description.

[0253] Moreover, it is also possible to mix pairs of link to point of view list and score and pairs of point of view and score, rather than representing all cases by a link to the point of view list.

[0254]FIG. 20 is a drawing showing a data configuration with pairs of point of view and score mixed. As can be seen from FIG. 20, segments 1803 and 1804 that have link information for the point of view table 1801 and a segment 2001 that does not have link information for the point of view table 1801 are mixed in the content.

[0255]FIG. 21 shows sample descriptions of the data configuration shown in FIG. 20. As can be seen from this drawing, it is not necessary to enter in the point of view table 1801 all the segment points of view that appear in the context contents description data, and only items referenced by a link are included. Also, segment 2001 does not include link information for the point of view table 1801.

Embodiment 6

[0256] A data adaptation apparatus according to Embodiment 6 of the present invention will now be described below.

[0257] In Embodiment 6, a point of view table showing a list of segment points of view that appear in context contents description data is provided, and is presented to the user before input.

[0258] The data structure according to Embodiment 6 will be described using FIG. 22.

[0259] Content according to Embodiment 6 is composed of a point of view table 2101 and a plurality of segments 2103 to 2105. Point of view table 2101 contains a plurality of segment points of view 2102 a to 2102 n.

[0260] Segment point of view 2106 and segment priority level 2107 are contained in segment 2103, segment point of view 2108 and segment priority level 2109 in segment 2104, and segment point of view 2110 and segment priority level 2122 in segment 2105. Unlike segments in Embodiment 5, segments 2103 to 2105 do not contain link information for point of view table 2101. That is to say, segments 2103 to 2105 and point of view table 2101 are configured independently.

[0261]FIG. 23 is a drawing showing an example of data descriptions according to Embodiment 6 of the present invention. As can be seen from FIG. 23, points of view 2106, 2108, and 2110 included in segments 2103 to 2105 are stored in point of view table 2101. To be specific, points of view 2301 to 2303 are stored for points of view 2106, 2108, and 2110.

[0262] Then point of view table 2101 is displayed before the user inputs a user point of view.

[0263] By this means, the user can ascertain the segment points of view that appear there before inputting a desired user point of view. Another effect is that user point of view input by the user can be carried out by making a selection from the point of view table.

Embodiment 7

[0264] A data adaptation apparatus according to Embodiment 7 of the present invention will now be described below.

[0265] In Embodiment 7, when context contents description data is to be represented so as to be capable of being processed by a computer, it is represented divided into a part that describes the structure and a part that describes points of view, which are attributes, and their scores.

[0266] Embodiment 7 will be described below using FIG. 24 and FIG. 25. FIG. 24 is a drawing showing the data structure according to Embodiment 7. FIG. 25 is a drawing showing data descriptions according to Embodiment 7.

[0267] Shown in the upper half of FIG. 24 is the structure part 2200 a which describes the structure, and shown in the lower half is the attribute part 2200 b which describes the attributes segment points of view and their priority levels. The content of structure part 2200 a includes descriptions of a plurality of segments 2201 a to 2201 n.

[0268] In this drawing, the part describing the structure describes the simplest structure, but configurations such as described in other embodiments can also be handled.

[0269] Also, the attribute part 2200 b includes descriptions of a plurality of segment points of view 2202 a and 2202 b. Pairs of link information 2203 a to 2203 f for the target segments and subsegments and priority levels 2204 a to 2204 f relating to segment points of view 2202 a and 2202 b are assembled for each of segment points of view 2202 a and 2202 b.

[0270] Next, the data structure according to Embodiment 7 will be described in detail using FIG. 25.

[0271] As can be seen from FIG. 25, the content includes a plurality of segments 2201 a to 2201 c. Segment 2201 a is assigned a segment ID number (id) 2301 a. In this example, id 2301 a is 1. Segment 2201 b is assigned a segment ID number (id) 2301 b. In this example, id 2301 b is 2. Segment 2201 n is assigned a segment ID number (id) 2301 n. In this example, id 2301 n is n.

[0272] Meanwhile, it can be seen from FIG. 25 that segment point of view 2202 a is “TeamA”. Also, segment point of view 2202 a includes a plurality of segment priority levels 2204 a to 2204 c. In this example, the priority level of segment priority level 2204 a is 3, the priority level of segment priority level 2204 b is 2, and the priority level of segment priority level 2204 c is 5.

[0273] Also, segment priority level 2202 a is assigned respective link information 2203 a to 2203 c. As link information 2203 a to 2203 c, reference numbers idref for referencing ID numbers 2301 a to 2301 c of segments 2201 a to 2201 c are written. In this example, idref of segment priority level 2204 a is 1, idref of segment priority level 2204 b is n, and idref of segment priority level 2204 c is 2. Thus, the target segment of segment priority level 2204 a is segment 2201 a, the target segment of segment priority level 2204 b is segment 2201 c, and the target segment of segment priority level 2204 c is segment 2201 n.

[0274] In this way it is possible to reference segments 2201 a to 2201 c from segment priority levels 2204 a to 2204 c.

[0275] Moreover, it can be seen from FIG. 25 that segment point of view 2202 b is “TeamB”. Also, segment point of view 2202 b includes a plurality of segment priority levels 2204 d to 2204 f. In this example, the priority level of segment priority level 2204 d is 4, the priority level of segment priority level 2204 e is 5, and the priority level of segment priority level 2204 f is 2.

[0276] Also, segment priority level 2202 b is assigned respective link information 2203 d to 2203 f. As link information 2203 d to 2203 f, reference numbers idref for referencing ID numbers 2301 a to 2301 c of segments 2201 a to 2201 c are written. In this example, idref of segment priority level 2204 d is 2, idref of segment priority level 2204 e is 3, and idref of segment priority level 2204 f is 1. Thus, the target segment of segment priority level 2204 d is segment 2201 b, the target segment of segment priority level 2204 e is segment 2201 c, and the target segment of segment priority level 2204 f is segment 2201 a

[0277] In this way it is possible to reference segments 2201 a to 2201 n from segment priority levels 2204 a to 2204 f.

[0278] Segment selection processing in the case of this kind of data structure will now be described. First, the above-described segment selection section 16 or 26 selects priority levels 2204 a to 2204 f for each of target segment points of view 2202 a and 2202 b from the parts contained in the attribute part 2200 b. As selected priority levels 2204 a to 2204 f are assigned link information 2203 a to 2203 f respectively, it is possible to select segments 2201 a to 2201 n which are the targets of selected priority levels 2203 a to 2203 f. By this means, segment selection sections 16 and 26 can select target segments 2201 a to 2201 n by specifying a point of view priority level 2204 a point of view for each of segments 2202 a and 2202 b.

[0279] The same effect is obtained if the link information 2203 a to 2203 f and priority level 2204 a to 2204 f parts are written separately rather than in the same file.

[0280] A mode can also be conceived whereby segments and segment points of view are linked in both directions.

[0281] This mode will be described below using FIG. 26 and FIG. 27. FIG. 26 is a drawing showing a data structure according to Embodiment 7. FIG. 27 is a drawing showing data descriptions according to Embodiment 7.

[0282] As in Embodiment 7, the data in this mode, also, is composed of a structure part 2400 a and an attribute part 2400 b. The content of the structure part 2400 a includes descriptions of a plurality of segments 2401 a to 2401 n. The attribute part 2400 b includes descriptions of a plurality of segment points of view 2402 a and 2402 b. Pairs of link information 2403 a to 2403 f for the target segments and subsegments and priority levels 2404 a to 2404 f relating to segment points of view 2402 a and 2402 b are assembled for each of segment points of view 2402 a and 2402 b.

[0283] Also, in this mode, since structure part 2400 a and attribute part 2400 b are linked in both directions, link information for segment priority levels 2402 a to 2404 f is also included in segment 2401 a to segment 2401 n.

[0284] Next, the data structure according to this embodiment will be described in detail using FIG. 27.

[0285] As can be seen from FIG. 27, the content includes a plurality of segments 2401 a to 2401 c. Segment 2401 a is assigned a segment ID number (id) 2501 a. In this example, id 2501 a is 1. Segment 2401 b is assigned a segment ID number (id) 2501 b. In this example, id 2501 b is 2. Segment 2401 c is assigned a segment ID number (id) 2501 c. In this example, id 2501 c is 3.

[0286] Meanwhile, segment point of view 2402 a includes a plurality of segment priority levels 2404 a to 2404 c. In this example, the priority level of segment priority level 2404 a is 3, the priority level of segment priority level 2404 b is 2, and the priority level of segment priority level 2404 c is 5.

[0287] Also, segment priority level 2402 a is assigned respective link information 2403 a to 2403 c. As link information 2403 a to 2403 c, reference numbers idref for referencing ID numbers 2501 a to 2501 c of segments 2401 a to 2401 c are written. In this example, idref of segment priority level 2404 a is 1, idref of segment priority level 2404 b is 2, and idref of segment priority level 2404 c is n.

[0288] Thus, the target segment of segment priority level 2404 a is segment 2401 a, the target segment of segment priority level 2404 b is segment 2401 b, and the target segment of segment priority level 2404 c is segment 2401 n.

[0289] Meanwhile, segment point of view 2402 b includes a plurality of segment priority levels 2404 d to 2404 f. In this example, the priority level of segment priority level 2404 d is 4, the priority level of segment priority level 2404 e is 5, and the priority level of segment priority level 2404 f is 2.

[0290] Also, segment priority level 2402 b is assigned respective link information 2403 d to 2403 f. As link information 2403 d to 2403 f, reference numbers idref for referencing ID numbers 2501 a to 2501 c of segments 2401 a to 2401 c are written. In this example, idref of segment priority level 2404 d is 2, idref of segment priority level 2404 e is 3, and idref of segment priority level 2204 f is 1.

[0291] Thus, the target segment of segment priority level 2404 d is segment 2401 b, the target segment of segment priority level 2404 e is segment 2401 c, and the target segment of segment priority level 2404 f is segment 2401 a.

[0292] Also, segment priority level 2402 a is assigned respective priority level ID numbers (idref) 2503 a to 2503 c. In this example, priority level ID number 2503 a is p110, priority level ID number 2503 b is p102, and priority level ID number 2503 c is p103.

[0293] Moreover, segment priority level 2402 b is assigned respective priority level ID numbers (idref) 2503 d to 2503 f. In this example, priority level ID number 2503 d is p201, priority level ID number 2503 e is p202, and priority level ID number 2503 f is p203.

[0294] Meanwhile segments 2401 a to 2401 n are assigned priority level reference numbers (idrefs) 2502 a to 2502 e for referencing priority level ID 2503 a to 2503 c, which are link information for segment priority levels 2404 a to 2404 f. In this example, idrefs 2502 a is p110, idrefs 2502 b is p203, idrefs 2502 c is p102, idrefs 2502 d is p201, and idrefs 2502 e is p202.

[0295] Thus, the target segment priority levels of segment 2401 a are segment priority levels 2404 a and 2404 f, the target segment priority levels of segment 2401 b are segment priority levels 2404 c and 2404 d, and the target segment priority level of segment 2401 n is segment priority level 2404 b.

[0296] In this way, segments 2401 a to 2401 n and segment priority levels 2204 a to 2204 f can be referenced in both directions. As a result, segment selection sections 16 and 26 can perform processing either using the method described in Embodiment 1 to Embodiment 6 or using the method described in Embodiment 7.

Embodiment 8

[0297] A data adaptation apparatus according to Embodiment 8 of the present invention will now be described below.

[0298] In Embodiment 8, as in Embodiment 7, context contents description data representation is divided into a part that describes the structure and a part that describes points of view, which are attributes, and their scores. However, in Embodiment 8, representation is not by means of a pair comprising a link to a segment and the segment priority level, but instead items are listed in high-to-low segment priority level order for each segment point of view.

[0299] Embodiment 8 will be described below using FIG. 28 and FIG. 29. FIG. 28 is a drawing showing the data structure according to Embodiment 8. FIG. 29 is a drawing showing data descriptions according to Embodiment 8.

[0300] As shown in FIG. 28, the data structure according to Embodiment 8 is composed of a structure part 2600 a that describes the structure and an attribute part 2600 b. The content of structure part 2600 a includes descriptions of a plurality of segments 2601 a to 2601 n. The attribute part 2600 b includes descriptions of a plurality of segment points of view 2602 a and 2602 b. Link information 2603 a to 2603 f for the target segment or subsegment is included for each of segment points of view 2602 a and 2602 b.

[0301] Next, the data structure according to Embodiment 8 will be described in detail using FIG. 29.

[0302] As can be seen from FIG. 29, the content includes a plurality of segments 2601 a to 2601 n. Segments 2601 a to 2601 n are assigned segment ID numbers (id) 2701 a to 2701 n, respectively. In this example, id 2701 a is 1, id 2701 b is 2, and id 2701 n is n.

[0303] Meanwhile, it can be seen from FIG. 29 that segment point of view 2602 a is “TeamA”. Also, segment point of view 2602 a is assigned respective link information 2603 a to 2603 c. As link information 2603 a to 2603 c, reference numbers idref 2702 a to 2702 c for referencing ID numbers 2701 a to 2701 n of segments 2601 a to 2601 n are written. In this example, idref 2702 a is 1, idref 2702 b is n, and idref 2702 c is 2.

[0304] Moreover, as regards link information 2603 a to 2603 c, since the description order is recognized as segment priority level, in this example the segment priority level of link information 2603 a is the highest and the segment priority level of link information 2603 c is the lowest.

[0305] Thus, the segment priority level of segment 2601 a is the highest and the segment priority level of segment 2601 b is the lowest.

[0306] Meanwhile, it can be seen from FIG. 29 that segment point of view 2602 b is “TeamB”. Also, segment point of view 2602 b is assigned respective link information 2603 d to 2603 f. As link information 2603 d to 2603 f, reference numbers idref 2702 d to 2702 f for referencing ID numbers 2701 a to 2701 n of segments 2601 a to 2601 n are written. In this example, idref 2702 d is 2, idref 2702 e is 3, and idref 2702 f is 1.

[0307] Moreover, as regards link in formation 2603 d to 2603 f, since the description order is recognized as segment priority level, in this example the segment priority level of link information 2603 d is the highest and the segment priority level of link information 2603 f is the lowest.

[0308] In this way, segments 2201 a to 2201 n can be referenced from segment points of view 2602 a and 2602 b, and priority levels can be determined, even though segment priority levels are not included in segment points of view 2602 a and 2602 b.

[0309] In FIG. 28, there is a different segment priority level for each segment (or subsegment), but it is also possible to describe items that have the same segment priority level, as shown in FIG. 30.

[0310] In the example shown in FIG. 30, in segment point of view 2802 of the attribute part 2800 items appear in high-to-low segment priority level order from left to right, and items with the same segment priority level are written aligned vertically.

[0311] To be specific, link information 2803 a and link information 2803 b are written aligned vertically, and link information 2803 a is written to the left of link information 2803 c. Link information 2803 a links to segment 2601 b, link information 2803 c links to segment 2601 a, and link information 2803 b links to segment 2601 n. That is to say, segment 2601 b and segment 2601 n have the same segment priority level, and segment 2601 a has a lower segment priority level than segment 2601 b and segment 2601 n.

[0312] The data structure in FIG. 30 will now be described in detail using FIG. 31.

[0313] As can be seen from FIG. 31, the content includes a plurality of segments 2601 a to 2601 n. Segments 2601 a to 2601 n are assigned segment ID numbers (id) 2901 a to 2901 n, respectively. In this example, id 2901 a is 1, id 2901 b is 2, and id 2901 n is n.

[0314] Meanwhile, it can be seen from FIG. 31 that segment point of view 2802 is “TeamA”. Also, segment point of view 2602 a is assigned respective link information (idref) 2803 a to 2803 c. In this example, idref 2803 a is 2, idref 2803 b is 1, and idref 2803 c is n.

[0315] Moreover, as regards link information 2803 a to 2803 c, since the description order is recognized as segment priority level, in this example the segment priority level of link information 2803 a is the highest and the segment priority level of link information 2803 c is the lowest.

[0316] Thus, the segment priority level of segment 2601 a is the highest and the segment priority level of segment 2601 b is the lowest.

[0317] In this way, it is possible to describe segments that have the same segment priority level even though segment priority levels are not included in segment points of view.

[0318] The above-described segment selection sections 16 and 26 perform segment selection using the method described in Embodiment 7.

Embodiment 9

[0319] In Embodiments 1 to 8 of the present invention, content identification is performed by means of a content identifier. However, content identification may also be performed by means of a keyword or keyword co-occurrence probability rather than performing content identification by means of a content identifier. Moreover, content identification may also be performed by means of another method.

[0320] Also, it is possible not to prepare user preferences for each content item, but to prepare user preferences as a number of preference categories or general preferences for individual age brackets or groups, etc., as defaults unrelated to a user's preferences.

[0321] In Embodiment 9, content identification is not performed by means of a content identifier. User preferences according to Embodiment 9 will be described in detail below using FIG. 32 and FIG. 33. FIG. 32 and FIG. 33 are drawings showing description definitions of user preferences according to Embodiment 9.

[0322] In the drawings, a user preference is indicated by UserPreference, a keyword by PreferenceSummaryTheme, duration information for displaying content by SummaryDuration, and a priority level corresponding to a keyword as preferencevalue.

[0323] As can be seen from the drawings, UserPreference 3201 is defined as including, as user information as elements, UserIdentifier 3202, which is an identifier for identifying the user, and UsagePreference 3203, which is user preference information. Also, UsagePreference 3203 is defined as including 0 items or 1 item.

[0324] Next, the definition of UserIdentifier 3202 will be described. As indicated by reference numeral 3204 in the drawings, UserIdentifier 3202 is defined as not including any elements. Also, UserIdentifier 3202 is defined as including protected 3204, which is information indicating whether rewriting is possible, and userName 3205, which is the user name, as attributes. For protected 3204, one of the following is selected: “true” meaning that rewriting is possible, “false” meaning that rewriting is not possible, or “user” meaning that rewriting may be possible depending on the user. The default setting for protected 3204 is “true”. userName 3205 is defined as CDATA—that is, text information. By default, userName 3205 is defined as “anonymous”.

[0325] Next, the definition of UsagePreference 3203 will be described. As indicated by reference numeral 3206 in the drawings, UsagePreference 3203 is defined as including, as elements, 0 or more BrowsingPreferences 3207 that hold information on, for example, conditions such as time, weather, etc. Also, UsagePreference 3203 is defined as including, as an attribute, allowAutomaticupdate 3208, which is information indicating whether automatic rewriting by an administrator, etc., is possible. For allowAutomaticupdate 3208, one of the following is selected: “true” meaning that rewriting is possible, “false” meaning that rewriting is not possible, or “user” meaning that rewriting may be possible depending on the user. The default setting for allowAutomaticupdate 3208 is “true”.

[0326] Next, the definition of BrowsingPreferences 3207 will be described. As indicated by reference numeral 3209 in the drawings, BrowsingPreferences 3207 is defined as having 0 or more Summarypreferences 3210 as elements. Also, BrowsingPreferences 3207 is defined as including, as elements, protected 3211, which is information indicating whether automatic rewriting is possible, and preferencevalue 3212, which is the priority level of BrowsingPreferences 3207, as attributes. For protected 3211, one of the following is selected: “true” meaning that rewriting is possible, “false” meaning that rewriting is not possible, or “user” meaning that rewriting may be possible depending on the user. The default setting for protected 3211 is “true”. preferencevalue 3212 is defined as CDATA—that is, text information. The default setting for preferencevalue 3212 is 100.

[0327] As BrowsingPreferences 3207 has preferencevalue 3212 in this way, it is possible to perform processing with Userpreference 3201 assigned a priority level even at a higher level, BrowsingPreferences 3207.

[0328] Next, the definition of SummaryPreferences 3210 will be described. As indicated by reference numeral 3301 in the drawings, SummaryPreferences 3210 is defined as having 0 or more PreferredSummaryTheme 3302 items, which are keywords, and 0 or 1 SummaryDuration 3303, which is display interval information, as elements.

[0329] Also, SummaryPreferences 3210 is defined as having preferencevalue 3304, which is a priority level, as an attribute.

[0330] The fact that SummaryPreferences 3210 has priority level preferencevalue 3304 as an attribute in this way makes it possible to perform processing with a priority level assigned even in BrowsingPreferences 3207, which is at a higher level than keyword PreferredSummaryTheme 3302.

[0331] Next, the definition of PreferredSummaryTheme 3302 will be described. As indicated by reference numeral 3305 in the drawings, PreferredSummaryTheme 3302 is defined as having text data as an element. Also, PreferredSummaryTheme 3302 is defined as having, as options, xml:lang 3306, which is language information, and preferencevalue 3307, which is priority level information, as attributes. The default setting for priority level information preferencevalue 3307 is 100.

[0332] The fact that PreferredSummaryTheme 3302 has priority level information preferencevalue 3307 in this way makes it possible to process PreferredSummaryTheme 3302 with a priority level assigned.

[0333] Also, as indicated by reference numeral 3308 in the drawings, SummaryDuration 3303 is defined as having text data as an element.

[0334] Thus, with user preferences according to Embodiment 9, it is possible to perform, not processing for particular content, but processing for each higher level: BrowsingPreferences 3207, SummaryPreferences 3210, and PreferredSummaryTheme 3302. Also, prioritized processing is possible for each level above PreferredSummaryTheme 3302—that is, BrowsingPreferences 3207 and SummaryPreferences 3210.

[0335] Next, an actual description of user preferences according to Embodiment 9 will be described using FIG. 34. FIG. 34 is a drawing showing a sample description of user preferences according to Embodiment 9. The sample user preference description shown in FIG. 34 is the sample user preference description shown in FIG. 4 adapted to Embodiment 9.

[0336] As indicated by reference numeral 3401 in the drawing, for UserIdentifier, “true” is entered for protected and “Bob” as userName. Also, as indicated by reference numeral 3402 in the drawing, for UsagePreferences, “false” is entered for allowAutomaticUpdate. And as indicated by reference numeral 3403 in the drawing, for BrowsingPreferences, “true” is entered for protected.

[0337] Also, in UserPreference 3400, two SummaryPreferences 3404 a and 3404 b are entered.

[0338] As indicated by reference numeral 3405 a in the drawing, for SummaryPreferences 3404 a, the information “Nakatal” is entered as PreferredSummaryTheme. preferencevalue of PreferredSummaryTheme indicated by reference numeral 3405 a in the drawing is 500. As indicated by reference numeral 3406 a in the drawing, for SummaryPreferences 3404 a, the information “Soccer” is entered as PreferredSummaryTheme. preferencevalue of PreferredSummaryTheme indicated by reference numeral 3406 a in the drawing is 400. As indicated by reference numeral 3407 a in the drawing, for SummaryPreferences 3404 a, the information “Japan” is entered as PreferredSummaryTheme. preferencevalue of PreferredSummaryTheme indicated by reference numeral 3407 a in the drawing is 200. And as indicated by reference numeral 3408 a in the drawing, “PT5M”—that is, information indicating 5 minutes-is entered for SummaryDuration.

[0339] As indicated by reference numeral 3405 b in the drawing, for SummaryPreferences 3404 b, the information “Headline” is entered as PreferredSummaryTheme. preferencevalue of PreferredSummaryTheme indicated by reference numeral 3405 b in the drawing is 500. As indicated by reference numeral 3406 b in the drawing, for SummaryPreferences 3404 b, the information “Stock” is entered as PreferredSummaryTheme. preferencevalue of PreferredSummaryTheme indicated by reference numeral 3406 b in the drawing is 500. As indicated by reference numeral 3407 b in the drawing, for SummaryPreferences 3404 b, the information “Sports” is entered as PreferredSummaryTheme. preferencevalue of PreferredSummaryTheme indicated by reference numeral 3407 b in the drawing is 300. And as indicated by reference numeral 3408 b in the drawing, “PT3M”—that is, information indicating 3 minutes—is entered for SummaryDuration.

[0340] As shown above, a description with contents corresponding to FIG. 4 can also be achieved by means of user preference definitions according to Embodiment 9.

[0341] Next, segment descriptions according to Embodiment 9 will be described. First, segment definitions according to Embodiment 9 will be described using FIG. 35 to FIG. 37. FIG. 35 to FIG. 37 are drawings showing segment description definitions according to Embodiment 9.

[0342] In this example, the definition of AudioVisualSegment, an audio and visual segment, will be described.

[0343] As indicated by reference numeral 3501 in the drawings, AudioVisualSegment 3502 is defined as including 0 or more PointofView 3503 and MediaTime 3504 items as elements. Pointofview 3503 is an element that includes a point of view relating to the segment. MediaTime 3504 is an element that includes the segment duration, etc.

[0344] Also, as indicated by reference numeral 3505 in the drawings, AudioVisualSegment 3502 is defined as having an identifier ID as an attribute. Moreover, AudiovisualSegment 3502 is defined as having, as attributes, URL reference information href as an option as indicated by reference numeral 3506 in the drawings, and ID reference information idref as an option as indicated by reference numeral 3507 in the drawings.

[0345] Next, the definition of PointofView 3503 will be described. As indicated by reference numeral 3508 in the drawings, Pointofview 3503 is defined as having, as elements, 0 or 1 SupplementalInfo 3509 item and 1 or more Value 3510 items. SupplementalInfo 3509 is a comment indicating the contents of Pointofview 3503. Value 3510 is priority level information for PointofView 3503.

[0346] As indicated by reference numeral 3511 in the drawings, Pointofview 3503 is defined as having identifier information id as an option in its attributes. Also, as indicated by reference numeral 3512 in the drawings, Pointofview 3503 is defined as having segment viewpoint viewpoint as an attribute. And viewpoint is defined as being written as text information.

[0347] Next, the definition of value 3510 will be described. As indicated by reference numeral 3513 in the drawings, Value 3510 is defined as including text information as an element. Also, as indicated by reference numeral 3514 in the drawings, Value 3510 is defined as having an identifier id as an attribute. Identifier id of Value 3510 is defined as being an option.

[0348] The fact that Pointofview 3503 and Value 3510 have id, and AudiovisualSegment 3502 has idref that references these id's makes it possible for AudioVisualSegment 3502 to reference PointofView 3503 and Value 3510 by means of idref. That is to say, AudioVisualSegment 3502 can link to Pointofview 3503 and Value 3510 by means of idref.

[0349] Next, the definition of SupplementalInfo 3509 will be described. As indicated by reference numeral 3601 in the drawings, SupplementalInfo 3509 is defined as having at least one FreeTextAnnotation 3602 or StructuredAnnotation 3603 as an element.

[0350] Also, as indicated by reference numeral 3604 in the drawings, SupplementalInfo 3509 is defined as having text data as an element. And, as indicated by reference numeral 3605 in the drawings, SupplementalInfo 3509 is defined as having language information as an attribute.

[0351] Next, the definition of StructuredAnnotation 3603 will be described. As indicated by reference numeral 3606 in the drawings, StructuredAnnotation 3603 is defined as having, as elements, 0 or 1 Who 3607 item, which is information indicating who performed an action, or 0 or 1 WhatObject 3608 item, which is information indicating the object of an action, or 0 or 1 WhatAction 3609 item, which is information indicating what was done, or 0 or 1 Where 3610 item, which is information indicating where an action was performed, or 0 or 1 When 3611 item, which is information indicating when an action was performed, or 0 or 1 Why 3612 item, which is information indicating why an action was performed.

[0352] As indicated by reference numerals 3613 to 3618 in the drawings, Who 3607, WhatObject 3608, WhatAction 3609, Where 3610, When 3611, and why 3612 are defined as including text information as elements.

[0353] Also, as indicated by reference numeral 3619 in the drawings, StructuredAnnotation 3603 is defined as having identifier information id as an attribute. And, as indicated by reference numeral 3620 in the drawings, StructuredAnnotation 3603 is defined as having language information as an attribute.

[0354] In this way, it is easy to identify what kind of information AudioVisualSegment 3502 is by means of StructuredAnnotation 3603.

[0355] Next, the definition of MediaTime 3504 will be described. As indicated by reference numeral 3701 in the drawings, MediaTime 3504 is defined as having MediaTimePoint 3702 and MediaDuration 3703 as elements. MediaTimePoint 3702 is AudioVisualSegment 3502 start time information and MediaDuration 3703 is AudioVisualSegment 3502 duration information.

[0356] Also, as indicated by reference numeral 3704 in the drawings, MediaTimePoint 3702 is defined as having text information as an element. And, as indicated by reference numeral 3705 in the drawings, MediaDuration 3703 is defined as having text information as an element.

[0357] AudioVisualSegment 3502 is defined as described above. Next, a sample description of AudioVisualSegment 3502 defined as shown above will be described.

[0358]FIG. 38 is a drawing showing a sample description that adapts the segment sample description shown in FIG. 17 to Embodiment 9.

[0359] As can be seen from FIG. 38, segment 1602 contains a segment point of view (keyword) ID number (id) 1701, as in the sample description in FIG. 17. Segment 1602 also contains a segment priority level (P) 1702 corresponding to the keyword. Also, “TeamA” is entered as a keyword in segment 1602.

[0360] Segment 1603 contains a reference number (idref) 1703 for another segment point of view (keyword) which is link information, as in the sample description in FIG. 17. Thus, the keyword of segment 1603 is “TeamA”. Segment 1603 also contains a segment priority level (P) 1704 corresponding to the keyword.

[0361] In this way, it is possible to link segments by means of Embodiment 9 also.

[0362] Next, the segment sample description shown in FIG. 19 adapted to Embodiment 9 will be described using FIG. 39.

[0363] As can be seen from FIG. 39, the point of view table 1801 contains segment points of view 1802 a to 1802 c. Segment point of view 1802 a contains an ID number (id) 1901 a. Also, segment point of view 1802 a is indicated by the text “A”.

[0364] Segment point of view 1802 b contains an ID number (id) 1901 b. Also, segment point of view 1802 b is indicated by the text “B”. Segment point of view 1802 c contains an ID number (id) 1901 c. Also, segment point of view 1802 c is indicated by the text “C”.

[0365] Meanwhile, segments 1803 to 1805 contain reference numbers (idref) 1903 a to 1903 c, respectively, which are link information for segment points of view 1802 a to 1802 c of the point of view table 1801.

[0366] Segment 1803 contains a segment priority level (P) 1904 a corresponding to the keyword. Segment 1804 contains a segment priority level (P) 1904 b corresponding to the keyword. Segment 1805 contains a segment priority level (P) 1904 c corresponding to the keyword.

[0367] In this way, it is easy to present a segment point of view list to the user in advance using Embodiment 9 also.

[0368] Next, the segment sample description shown in FIG. 21 adapted to Embodiment 9 will be described using FIG. 40.

[0369] As can be seen from FIG. 40, in the point of view table 1801 it is not necessary to enter all the segment points of view that appear in the context contents description data, and only items referenced by a link are included. Also, segment 2001 does not include link information for the point of view table 1801.

[0370] Thus, it is possible to adapt the description in FIG. 21 to Embodiment 9 by means of the kind of description shown in FIG. 40.

[0371] Next, the segment sample description shown in FIG. 23 adapted to Embodiment 9 will be described using FIG. 41.

[0372] As can be seen from FIG. 41, points of view 2106, 2108, and 2110 included in segments 2103 to 2105 are stored in point of view table 2101. To be specific, points of view 2301 to 2303 are stored for points of view 2106, 2108, and 2110.

[0373] Then point of view table 2101 is displayed before the user inputs a user point of view. Thus, it is possible to adapt the description in FIG. 23 to Embodiment 9 by means of the kind of description shown in FIG. 41.

[0374] Next, the segment sample description shown in FIG. 25 adapted to Embodiment 9 will be described using FIG. 42.

[0375] As can be seen from FIG. 42, the content includes a plurality of segments 2201 a to 2201 c. Segment 2201 a is assigned a segment ID number (id) 2301 a. Segment 2201 b is assigned a segment ID number (id) 2301 b. Segment 2201 c is assigned a segment ID number (id) 2301 c.

[0376] Meanwhile, it can be seen that segment point of view 2202 a is “TeamA” . Also, segment point of view 2202 a includes a plurality of segment priority levels 2204 a to 2204 c.

[0377] In addition, segment priority level 2202 a is assigned respective link information 2203 a to 2203 c. As link information 2203 a to 2203 c, reference numbers idref for referencing ID numbers 2301 a to 2301 c of segments 2201 a to 2201 c are written.

[0378] In this way it is possible to reference segments 2201 a to 2201 c from segment priority levels 2204 a to 2204 c.

[0379] Moreover, it can be seen that segment point of view 2202 b is “TeamB”. Also, segment point of view 2202 b includes a plurality of segment priority levels 2204 d to 2204 f.

[0380] In addition, segment priority level 2202 b is assigned respective link information 2203 d to 2203 f. As link information 2203 d to 2203 f, reference numbers idref for referencing ID numbers 2301 a to 2301 c of segments 2201 a to 2201 c are written.

[0381] In this way it is possible to reference segments 2201 a to 2201 n from segment priority levels 2204 a to 2204 f.

[0382] Thus, it is possible to adapt the description in FIG. 25 to Embodiment 9 by means of the kind of description shown in FIG. 42.

[0383] Next, the segment sample description shown in FIG. 27 adapted to Embodiment 9 will be described using FIG. 43 and FIG. 44.

[0384] As can be seen from the drawings, the content includes a plurality of segments 2401 a to 2401 c. Segment 2401 a is assigned a segment ID number (id) 2501 a. Segment 2401 b is assigned a segment ID number (id) 2501 b. Segment 2401 c is assigned a segment ID number (id) 2501 c.

[0385] Meanwhile, segment point of view 2402 a includes a plurality of segment priority levels 2404 a to 2404 c.

[0386] Also, segment priority level 2402 a is assigned respective link information 2403 a to 2403 c. As link information 2403 a to 2403 c, reference numbers idref for referencing ID numbers 2501 a to 2501 c of segments 2401 a to 2401 c are written.

[0387] Thus, the target segment of segment priority level 2404 a is segment 2401 a, the target segment of segment priority level 2404 b is segment 2401 b, and the target segment of segment priority level 2404 c is segment 2401 n.

[0388] Meanwhile, segment point of view 2402 b includes a plurality of segment priority levels 2404 d to 2404 f. Also, segment priority level 2402 b is assigned respective link information 2403 d to 2403 f. As link information 2203 d to 2403 f, reference numbers idref for referencing ID numbers 2501 a to 2501 c of segments 2401 a to 2401 c are written.

[0389] Thus, the target segment of segment priority level 2404 d is segment 2401 b, the target segment of segment priority level 2404 e is segment 2401 c, and the target segment of segment priority level 2404 f is segment 2401 a.

[0390] Also, segment priority level 2402 a is assigned respective priority level ID numbers (idref) 2503 a to 2503 c, and segment priority level 2402 b is assigned respective priority level ID numbers (idref) 2503 d to 2503 f.

[0391] Meanwhile segments 2401 a to 2401 c are assigned priority level reference numbers (idrefs) 2502 a to 2502 e for referencing priority level ID 2503 a to 2503 c, which are link information for segment priority levels 2404 a to 2404 f.

[0392] Thus, the target segment priority levels of segment 2401 a are segment priority levels 2404 a and 2404 f, the target segment priority levels of segment 2401 b are segment priority levels 2404 b and 2404 d, and the target segment priority level of segment 2401 c is segment priority level 2404 e.

[0393] In this way, segments 2401 a to 2401 c and segment priority levels 2204 a to 2204 f can be referenced in both directions using Embodiment 9 also.

[0394] Next, the segment sample description shown in FIG. 29 adapted to Embodiment 9 will be described using FIG. 45.

[0395] As can be seen from the drawing, the content includes a plurality of segments 2601 a to 2601 c. Segments 2601 a to 2601 c are assigned segment ID numbers (id) 2701 a to 2701 c, respectively.

[0396] Meanwhile, it can be seen from the drawing that segment point of view 2602 a is “TeamA”. Also, segment point of view 2602 a is assigned respective link information 2603 a to 2603 c. As link information 2603 a to 2603 c, reference numbers idref 2702 a to 2702 c for referencing ID numbers 2701 a to 2701 n of segments 2601 a to 2601 n are written.

[0397] Moreover, as regards link information 2603 a to 2603 c, since the description order is recognized as segment priority level, in this example the segment priority level of link information 2603 a is the highest and the segment priority level of link information 2603 c is the lowest.

[0398] Thus, the segment priority level of segment 2601 a is the highest and the segment priority level of segment 2601 b is the lowest.

[0399] Meanwhile, it can be seen from the drawing that segment point of view 2602 b is “TeamB”. Also, segment point of view 2602 b is assigned respective link information 2603 d to 2603 f. As link information 2603 d to 2603 f, reference numbers idref 2702 d to 2702 f for referencing ID numbers 2701 a to 2701 c of segments 2601 a to 2601 c are written.

[0400] Moreover, as regards link information 2603 d to 2603 f, since the description order is recognized as segment priority level, in this example the segment priority level of link information 2603 d is the highest and the segment priority level of link information 2603 f is the lowest.

[0401] Thus, the segment priority level of segment 2601 b is the highest and the segment priority level of segment 2601 a is the lowest.

[0402] Thus, it is possible to adapt the description in FIG. 29 to Embodiment 9 by means of the description shown in FIG. 45.

[0403] Next, the segment sample description shown in FIG. 31 adapted to Embodiment 9 will be described using FIG. 46.

[0404] As can be seen from the drawing, the content includes a plurality of segments 2601 a to 2601 c. Segments 2601 a to 2601 c are assigned segment ID numbers (id) 2901 a to 2901 c, respectively.

[0405] Meanwhile, it can be seen from the drawing that segment point of view 2802 is “TeamA”. Also, segment point of view 2602 a is assigned respective link information (idref) 2803 a to 2803 c.

[0406] Moreover, as regards link information 2803 a to 2803 c, since the description order is recognized as segment priority level, in this example the segment priority level of link information 2803 a is the highest and the segment priority level of link information 2803 c is the lowest.

[0407] Thus, the segment priority level of segment 2601 a is the highest and the segment priority level of segment 2601 b is the lowest.

[0408] Thus, it is possible to adapt the description in FIG. 31 to Embodiment 9 using the description shown in FIG. 46.

Embodiment 10

[0409] In Embodiment 1 to Embodiment 9, user preferences have been described in a mode whereby they are written in XML-DTD, but user preferences may also be written in RDF, XML-Schema, or other XML-based languages, or a non-XML language, or using non-language descriptions.

[0410] In Embodiment 10, user preferences are written in XML-Schema. User preference definitions according to Embodiment 10 will be described below using FIG. 47 to FIG. 51. FIG. 47 to FIG. 51 are drawings showing user preference description definitions according to Embodiment 10. Also, FIG. 47 to FIG. 51 correspond to user preference description definitions according to Embodiment 9.

[0411] As can be seen from the drawings, UserPreference 3201 is defined as including, as user information as elements, UserIdentifier 3202, which is an identifier for identifying the user, and UsagePreference 3203, which is user preference information. Also, UsagePreference 3203 is defined as including 0 items or 1 item.

[0412] Next, the definition of UsagePreference 3203 will be described. As indicated by reference numeral 4803 in the drawings, UsagePreference 3203 is defined as including 0 or more BrowsingPreferences 3207. Also, UsagePreference 3203 is defined as including allowAutomaticUpdate 3208 as an attribute. In addition, as indicated by reference numeral 4801 in the drawings, UsagePreference 3203 is defined as including 0 or more FilteringAndSearchPreferences 4802 as elements.

[0413] Next, the definition of BrowsingPreferences 3207 will be described. As indicated by reference numeral 4900 in the drawings, BrowsingPreferences 3207 is defined as having 0 or more Summarypreferences 3210 as elements. Also, BrowsingPreferences 3207 is defined as including protected 3211 and preferencevalue 3212 as attributes. In addition, BrowsingPreferences 3207 is defined as including 0 or more PreferenceConditionType 4902 items as elements.

[0414] Next, the definition of SummaryPreferences 3210 will be described. As indicated by reference numeral 5002 in the drawings, SummaryPreferences 3210 is defined as having 0 or more elements called SummaryPreferencesType as an extension of summaryComponentType, which holds a list of the kind indicated by reference numeral 5003 in the drawings. Also, SummaryPreferences 3210 is defined as having 0 or more PreferredSummaryTheme 3302 items, which are keywords, and 0 or 1 SummaryDuration 3303, which is display interval information, as elements.

[0415] In addition, SummaryPreferences 3210 is defined as having preferencevalue 3304, which is a priority level, as an attribute. The default value of preferencevalue 3304 is defined as being 100.

[0416] Also, PreferredSummaryTheme 3302 is defined as having text data and language information as TextualType—that is, elements. In addition, PreferredSummaryTheme 3302 is defined as having priority level information preferencevalue 3307 as an attribute.

[0417] Moreover, as indicated by reference numerals 5101 to 5110 in the drawings, SummaryPreferences 3210 is defined as having, as elements, MinSummaryDuration indicating the minimum duration, MaxSummaryDuration indicating the maximum duration, NumOfKeyFrames indicating the number of display frames, MinNumOfKeyFrames indicating the minimum number of display frames, MaxNumOfKeyFrames indicating the maximum number of display frames, NumOfChars indicating the number of display characters, MinNumOfChars indicating the minimum number of display characters, and MaxNumOfChars indicating the maximum number of display characters.

[0418] As indicated by reference numeral 5110 in the drawings, these elements are defined as having a priority level as an attribute.

[0419] Thus, user preferences can be described using XML-Schema, using FIG. 47 to FIG. 51.

[0420] Next, an actual example of user preference description definitions according to Embodiment 10will be described using FIG. 52. FIG. 52 is a drawing showing a sample user preference description according to Embodiment 10.

[0421] As indicated by reference numeral 5201 in the drawing, for UserIdentifier, “true” is entered for protected and “Mike” as userName. Also, as indicated by reference numeral 5202 in the drawing, for UsagePreferences, “false” is entered for allowAutomaticUpdate. And as indicated by reference numeral 5203 in the drawing, for BrowsingPreferences, “true” is entered for protected.

[0422] Also, in UserPreference 5200, two SummaryPreferences 5204 are entered.

[0423] As indicated by reference numeral 5205 in the drawing, for SummaryPreferences 5204, the information “Free-kick” is entered as PreferredSummaryTheme. Also, as indicated by reference numeral 5206 in the drawing, for SummaryPreferences 5204, the information “Goals” is entered as PreferredSummaryTheme. And as indicated by reference numeral 5208 in the drawing, “PT5M”—that is, information indicating 5 minutes—is entered for SummaryDuration.

[0424] In this way, user preferences can be described using XML-Schema.

[0425] In Embodiment 10, segment descriptions are also written using XML-Schema. Segment descriptions according to Embodiment 10 will be described below. First, segment definitions according to Embodiment 10 will be described using FIG. 53 to FIG. 56. FIG. 53 to FIG. 56 are drawings showing segment description definitions according to Embodiment 10.

[0426] A segment according to Embodiment 10 is defined as Segment DS, an abstract segment, shown in FIG. 53 and FIG. 54. AudioVisualSegment DS, AudioSegment DS, VideoSegment DS, StillRegion DS, and MovingRegion DS, respectively, are concrete description definitions succeeding Segment DS. AudioVisualSegment DS will be described below, but first Segment DS will be described.

[0427] As indicated by reference numeral 5300 in the drawings, Segment is declared as abstract type.

[0428] As indicated by reference numeral 5301 in the drawings, Segment is defined as having MediaInformation, which is media information on the coding format, etc., as an element. Also, as indicated by reference numeral 5302 in the drawings, Segment is defined as having MediaLocator, which is link information for the actual body of this segment, as an element. In addition, as indicated by reference numeral 5303 in the drawings, Segment is defined as having CreateInformation, which is manufacturer information such as copyright information, as an element. Moreover, as indicated by reference numeral 5304 in the drawings, Segment is defined as having UsageInformation, which is usage information such as usage limitations, as an element. Also, as indicated by reference numeral 5305 in the drawings, Segment is defined as having TextAnnotation, which is segment annotation, as an element. Also, as indicated by reference numeral 5307 in the drawings, Segment is defined as having PointofView, which is segment annotation, as an element. In addition, as indicated by reference numeral 5307 in the drawings, Segment is defined as having TextAnnotation, which is a segment point of view (keyword), as an element. And, as indicated by reference numeral 5308 in the drawings, Segment is defined as having SegmentDecomposition, which is used for specifying subsegments, as an element.

[0429] Also, as indicated by reference numeral 5311 in the drawings, Segment is defined as having an identifier id as an attribute. In addition, as indicated by reference numeral 5312 in the drawings, Segment is defined as having URL link information href as an attribute. And, as indicated by reference numeral 5313 in the drawings, Segment is defined as having id link information idref as an attribute.

[0430] Thus, Segment has keyword information Pointofview, an identifier id, and idref, which is reference information for other segment identifiers.

[0431] Next, the aforementioned AudioVisualSegment succeeding the abstract segment will be described using FIG. 55.

[0432] As indicated by reference numeral 5501 in the drawing, AudioVisualSegment extends the above-described abstract segment.

[0433] Also, as indicated by reference numeral 5502 in the drawing, AudiovisualSegment is defined as having MediaTime, which indicates the start time, as an extended element.

[0434] Moreover, as indicated by reference numeral 5504 in the drawing, AudiovisualSegment is defined as having idref, which is reference information for another segment, as an attribute.

[0435] Thus, AudioVisualSegment has reference information idref in the same way as Embodiment 9.

[0436] Next, the definition of Pointofview will be described using FIG. 56. The type of Pointofview is declared as indicated by reference numeral 5600 in the drawing.

[0437] As indicated by reference numeral 5601 in the drawing, PointofView is defined as having SupplementalInfo as an element. Also, as indicated by reference numeral 5602 in the drawing, Pointofview is defined as having Value as an element.

[0438] The type of Value is PrimitiveImportanceType shown by reference numeral 5603 in the drawing. As indicated by reference numeral 5604 in the drawing, PrimitiveImportanceType is defined as having segment id reference information idref as an attribute.

[0439] Also, as indicated by reference numeral 5606 in the drawing, Pointofview is defined as having segment viewpoint viewpoint, written as text, as an attribute.

[0440] Thus, PointofView has id and idref in the same way as Embodiment 9.

[0441] Next, a sample segment description based on the above-described definitions will be described using FIG. 57 to FIG. 59. FIG. 57 to FIG. 59 are drawings showing a sample segment description according to Embodiment 10.

[0442] The sample description shown in FIG. 57 to FIG. 59 is an example in which Pointofview is written within the segment structure.

[0443] In this example, as indicated by reference numeral 5700 in the drawings, id has a segment called “FootBallGame”. As indicated by reference numerals 5701 a and 5701 b in the drawings, the segment that has this “FootBallGame” id is composed of two subsegments. Also the subsegment indicated by reference numeral 5701 a in the drawings has a subsegment 5702 a for which id is “seg1”, a subsegment 5702 b for which id is “seg2”, and a subsegment 5702 c for which id is “seg2”.

[0444] Subsegment 5702 a has a viewPoint “TeamA” for which priority level Value is 0.3, as indicated by reference numeral 5703 a in the drawings, and a viewpoint “TeamB” for which priority level Value is 0.7, as indicated by reference numeral 5703 b in the drawings. In addition, subsegment 5702 a also has MediaTime information as indicated by reference numeral 5704 a in the drawings.

[0445] Subsegment 5702 b has a viewpoint “TeamA” for which priority level Value is 0.5, as indicated by reference numeral 5703 c in the drawings. In addition, subsegment 5702 a also has MediaTime information as indicated by reference numeral 5704 b in the drawings.

[0446] Subsegment 5702 c has a viewpoint “TeamA” for which priority level Value is 0.8, as indicated by reference numeral 5703 d in the drawings, and a viewpoint “TeamB” for which priority level Value is 0.2, as indicated by reference numeral 5703 e in the drawings. In addition, subsegment 5702 a also has MediaTime information as indicated by reference numeral 5704 c in the drawings.

[0447] Meanwhile, the subsegment indicated by reference numeral 5701 b in the drawings has a subsegment 5702 d for which id is “2seg1”, a subsegment 5702 e for which id is “2seg2”, and a subsegment 5702 f for which id is “2seg20”. Subsegment 5702 d has a viewpoint “TeamA” for which priority level Value is 0.3, as indicated by reference numeral 5703 f in the drawings. In addition, subsegment 5702 b also has MediaTime information as indicated by reference numeral 5704 d in the drawings.

[0448] Subsegment 5702 b has a viewpoint “TeamA” for which priority level Value is 0.5, as indicated by reference numeral 5703 g in the drawings. In addition, subsegment 5702 a also has MediaTime information as indicated by reference numeral 5704 e in the drawings.

[0449] Subsegment 5702 f has a viewpoint “TeamA” for which priority level Value is 0.8, as indicated by reference numeral 5703 h in the drawings. In addition, subsegment 5702 f also has MediaTime information as indicated by reference numeral 5704 f in the drawings.

[0450] In this way, in the sample description shown in FIG. 57 to FIG. 59, PointOfview is written within the segment structure.

[0451] Next, a sample description that separates the segment structure and PointOfView structure will be described using FIG. 60 and FIG. 61. FIG. 60 and FIG. 61 are drawings showing another example of a segment description according to Embodiment 10.

[0452] In this example, as indicated by reference numeral 6000 in the drawings, id has a segment structure called “FootBallGame” and PointOfView structures 6005 and 6008. As indicated by reference numeral 6001 in the drawings, the segment structure that has this “FootBallGame” id is composed of one subsegment. Also the subsegment indicated by reference numeral 6001 in the drawings has a subsegment 6004 a for which id is “seg1”, a subsegment 6004 b for which id is “seg2”, and a subsegment 6004 c for which id is “seg20”.

[0453] Subsegment 6002 a has MediaTime information as indicated by reference numeral 6004 a in the drawings. Subsegment 6002 b has MediaTime information as indicated by reference numeral 6004 b in the drawings. Subsegment 6002 c has MediaTime information as indicated by reference numeral 6004 c in the drawings.

[0454] Subsegment 6001, also, has MediaTime information, as indicated by reference numeral 6004 d in the drawings.

[0455] Meanwhile, PointOfview structure 6005 has a PointOfview “TeamA”. Also, PointOfView structure 6005 has segment reference information 6006 a to 6006 c. Segment reference information 6006 a has 0.3 as Value, and its segment reference information idref is “seg1”. Segment reference information 6006 b has 0.5 as Value, and its segment reference information idref is “seg2”. Segment reference information 6006 c has 0.8 as Value, and its segment reference information idref is “seg20”.

[0456] PointOfView structure 6008 has a PointOfView “TeamB”. Also, PointOfView structure 6008 has segment reference information 6009 a and 6009 b. Segment reference information 6009 a has 0.7 as Value, and its segment reference information idref is “seg1”. Segment reference information 6009 b has 0.2 as Value, and its segment reference information idref is “seg20”.

[0457] Thus, since PointOfView has information that references the segment id in Embodiment 10, also, it is possible to separate the segment structure and PointOfView structure.

Embodiment 11

[0458] In the above-described embodiments, a point of view (keyword) is assigned to a segment, and segment extraction is performed using that point of view. Then, a plurality of segments extracted in this way are grouped together, and a digest is created.

[0459] In Embodiment 11, a point of view (keyword) is assigned to this digest. By this means, it is possible to perform digest extraction using a point of view.

[0460] A digest according to Embodiment 11 will be described below using FIG. 62 to FIG. 65. First, the definition of a digest (shown as HierarchicalSummary in the drawings) will be described using FIG. 62 and FIG. 63.

[0461] The type of HierarchicalSummary is declared as indicated by reference numeral 6200 in the drawings. Also, as indicated by reference numeral 6201 in the drawings, HierarchicalSummary is defined as having SummaryThemeList, which is a list of points of view (keywords), as an element. Moreover, as indicated by reference numeral 6202 in the drawings, HierarchicalSummary is defined as having HighlightLevel, which is information indicating what kind of segment configuration HierarchicalSummary has, as an element.

[0462] Also, as indicated by reference numeral 6203 in the drawings, HierarchicalSummary is defined as having summaryComponentList as an attribute. summaryComponentList succeeds summaryComponentListType indicating what kind of configuration HierarchicalSummary has. To be specific, summaryComponentListType has a configuration comprising keyFrames indicating the frame configuration as a list, keyVideoClips indicating the video clip configuration, keyAudioClips indicating the audio clip configuration, keyThemes indicating the theme configuration, and unconstrained indicating restriction conditions.

[0463] Next, the definition of SummaryThemeList, the HierarchicalSummary point of view (keyword) list, will be described using FIG. 64.

[0464] The type of SummaryThemeList is declared as indicated by reference numeral 6400 in the drawing.

[0465] Also, as indicated by reference numeral 6401 in the drawing, SummaryThemeList is defined as having SummaryTheme, which is a HierarchicalSummary viewpoint, as an element. SummaryTheme is defined as also having language information, which is text information.

[0466] In addition, as indicated by reference numeral 6402 in the drawing, SummaryTheme is defined as having identifier id as an attribute. And, as indicated by reference numeral 6403 in the drawing, SummaryTheme is defined as having parentId, which is reference information for another high-level SummaryTheme.

[0467] In this way, it is possible to achieve a hierarchical notation for SummaryTheme.

[0468] Next, the definition of HighlightLevel, which is information indicating what kind of segment configuration HierarchicalSummary has, will be described using FIG. 65.

[0469] HighlightLevel is declared as indicated by reference numeral 6500 in the drawing. Also, as indicated by reference numeral 6501 in the drawing, HighlightLevel is defined as having HighlightSegment, which is information on segments to be included in HierarchicalSummary, as an element.

[0470] Moreover, as indicated by reference numeral 6502 in the drawing, HighlightLevel has HighlightLevel as an element. By this means, it is possible to have a HighlightLevel at a lower level than HighlightLevel, and a recursive HighlightLevel configuration can be provided.

[0471] Also, as indicated by reference numerals 6503 to 6506 in the drawing, HighlightLevel has, as attributes, name, which is HighlightLevel name information, level, which is HighlightLevel priority level information, duration, which is HighlightLevel length information, and themeIds, which is information on which SummaryTheme is to be referenced.

[0472] In this way it is possible to link HighlightLevel to SummaryTheme.

[0473] Next, an actual example of SummaryTheme created on the basis of a HierarchicalSummary definition will be described using FIG. 66.

[0474] SummaryThemeList 6600 includes SummaryTheme 6601 a to SummaryTheme 6601 f.

[0475] As indicated by reference numeral 6602 a in the drawing, SummaryTheme 6601 a is shown in English. Also, as indicated by reference numeral 6603 a in the drawing, SummaryTheme 6601 a has id “item0”. And, as indicated by reference numeral 6604 a in the drawing, the content of SummaryTheme 6601 a is “baseball”.

[0476] As indicated by reference numeral 6602 b in the drawing, SummaryTheme 6601 b is shown in English. Also, as indicated by reference numeral 6603 b in the drawing, SummaryTheme 6601 b has id “item01”. Moreover, as indicated by reference numeral 6604 b in the drawing, the content of SummaryTheme 6601 b is “home run”. And, as indicated by reference numeral 6605 b in the drawing, SummaryTheme 6601 b has parentID“item0”. That is to say, SummaryTheme 6601 b is a SummaryTheme positioned at a lower level of SummaryTheme 6601 a.

[0477] As indicated by reference numeral 6602 c in the drawing, SummaryTheme 6601 c is shown in English. Also, as indicated by reference numeral 6603 c in the drawing, SummaryTheme 6601 c has id “item1”. Moreover, as indicated by reference numeral 6604 c in the drawing, the content of SummaryTheme 6601 c is “basketball”. In addition, SummaryTheme 6601 a has parentID “item0”.

[0478] As indicated by reference numeral 6602 d in the drawing, SummaryTheme 6601 d is shown in English. Also, as indicated by reference numeral 6603 d in the drawing, SummaryTheme 6601 d has id “item11”. Moreover, as indicated by reference numeral 6604 d in the drawing, the content of SummaryTheme 6601 d is “three-pointer”. And, as indicated by reference numeral 6605 d in the drawing, SummaryTheme 6601 d has parentID “item1”. That is to say, SummaryTheme 6601 d is a SummaryTheme positioned at a lower level of SummaryTheme 6601 c.

[0479] As indicated by reference numeral 6602 e in the drawing, SummaryTheme 6601 e is shown in English. Also, as indicated by reference numeral 6603 e in the drawing, SummaryTheme 6601 e has id “item12”. Moreover, as indicated by reference numeral 6604 e in the drawing, the content of SummaryTheme 6601 e is “slamdunk”. And, as indicated by reference numeral 6605 e in the drawing, SummaryTheme 6601 e has parentID “item1”. That is to say, SummaryTheme 6601 e is a SummaryTheme positioned at a lower level of SummaryTheme 6601 c.

[0480] As indicated by reference numeral 6602 f in the drawing, SummaryTheme 6601 f is shown in English. Also, as indicated by reference numeral 6603 f in the drawing, SummaryTheme 6601 f has id “item2”. Moreover, as indicated by reference numeral 6604 f in the drawing, the content of SummaryTheme 6601 f is “soccer”.

[0481] By the fact of a SummaryTheme having a parentID in this way, it is possible to provide a link to another SummaryTheme. In addition, it is possible to link SummaryThemes hierarchically.

[0482] Next, a sample HierarchicalSummary description using SummaryThemeList will be described using FIG. 67.

[0483] As indicated by reference numeral 6700 in the drawing, HierarchicalSummary is declared as having the name “keyThemesSummary001”.

[0484] Also, HierarchicalSummary is composed of a SummaryThemeList 6701, a HighlightLevel 6702 a with the name “summary001”, and a HighlightLevel 6702 b with the name “summary002”.

[0485] SummaryThemeList 6701 has a SummaryTheme 6703 a called “slam dunk”. SummaryTheme 6703 a has id “E0”. Also, SummaryThemeList 6701 has a SummaryTheme 6703 b called “3-point shots”. And SummaryTheme 6703 b has id Meanwhile, HighlightLevel 6702 a has a segment configuration as indicated by reference numeral 6704 a in the drawing. Also, as indicated by reference numeral 6705 a in the drawing, HighlightLevel 6702 a has themeIds “E0”. That is to say, HighlightLevel 6702 a is linked to SummaryTheme 6703 a that has id “E0”. Thus, HighlightLevel 6702 a has the SummaryTheme “slam dunk”.

[0486] HighlightLevel 6702 b has a segment configuration as indicated by reference numeral 6704 b in the drawing. Also, as indicated by reference numeral 6705 b in the drawing, HighlightLevel 6702 b has themeIds “E1”. That is to say, HighlightLevel 6702 b is linked to SummaryTheme 6703 b that has id “E1”. Thus, HighlightLevel 6702 b has the SummaryTheme “3-point shots”.

[0487] In this way, it is possible to give HierarchicalSummary a SummaryTheme.

[0488] In this way, also, it is possible to link a HighlightLevel and SummaryTheme. Therefore, HighlightLevel and SummaryTheme can be described divided into separate configurations.

[0489] In Embodiment 1 to Embodiment 11, it is possible to use a user usage history, purchase history, or event history, a template prepared beforehand, or anything of the kind, for user preferences.

[0490] Also, in Embodiment 1 to Embodiment 11, the content identifier, duration, keyword, prioritylevel, or keyword priority related description method is not limited to these embodiments.

[0491] Moreover, in Embodiment 1 to Embodiment 11, a terminal preference may be an ID representing a terminal category (for example, PC use or portable terminal use) rather than an actual terminal type or terminal capability value. Also, terminal preferences may be determined uniquely according to the terminal, or may be updated by means of a firmware or software version upgrade.

[0492] Further, in Embodiment 1 to Embodiment 11, data may be other than audio/video or document data.

[0493] Still further, in Embodiment 1 to Embodiment 11, it is possible for the user adaptive control section not to update user preferences. Moreover, there may be a plurality of different user preference descriptions for the same content.

[0494] Also, in Embodiment 1 to Embodiment 10, there may be a number of segment and subsegment levels, from 1 upward.

[0495] Moreover, in Embodiment 2, user preferences, terminal preferences, and network preferences may be on the server side or a totally separate management site rather than on the terminal side. Also, network preferences may be determined uniquely according to the contracted terminal service, or may be determined uniquely or dynamically according to the status of communication between the terminal and the server.

[0496] Further, all or part of the operation of each part of the above-described present invention may be embodied in a program, that program stored on a storage medium that can be read by a computer, and that program executed using a computer, in order to realize the operation of each part.

[0497] Still further, the above-described present invention may be realized using dedicated hardware that makes manifest the function of each part of the present invention.

[0498] Also, all or part of the operation of each part included in the above-described present invention may be used in the form of a computer program product for execution by a computer.

[0499] This application is based on the Japanese Patent Application No.HEI 11-344476 filed on Dec. 3, 1999, and the Japanese Patent Application No.2000-066531 filed on Mar. 10, 2000, entire content of which is expressly incorporated by reference herein.

Industrial Applicability

[0500] As described above, according to the present invention, firstly, by providing user preference information as user preferences for each content, selecting a data segment according to user preferences, and performing resolution conversion based on segment priority level and terminal capability, it is possible to perform data adaptation for each content in a form in which the user wishes to see it; and secondly, by acquiring information on the network transmission band as a network preference when content is distributed via a network, and adjusting the data quantity according to the segment priority and transmission band, it is possible to perform data adaptation of content in the form in which the user wishes to receive it and in a scalable fashion according to the network status. 

1. A content adaptation apparatus comprising: a content data acquisition section which acquires content and metadata of said content; a user preference acquisition section which acquires user preference information relating to a user's preferences; and a user adaptation section which adapts said content to said user preferences using said metadata.
 2. The content adaptation apparatus according to claim 1, wherein said user preference information is composed of user points of view for selecting arbitrary said segments from segments of said content.
 3. The content adaptation apparatus according to claim 2, wherein said user points of view are assigned a user priority level for each said user point of view.
 4. The content adaptation apparatus according to claim 2, wherein said metadata is composed of a segment point of view assigned to each said segment and indicating the contents of said segment, and a segment priority level assigned to each said segment point of view.
 5. The content adaptation apparatus according to claim 4, wherein said user adaptation section extracts said segment point of view from said metadata, compares said extracted segment point of view with said user point of view included in said user preference information, and extracts said segment that has a matching said segment point of view.
 6. The content adaptation apparatus according to claim 4, wherein said user adaptation section extracts said segment point of view and said segment priority level from said metadata, compares said extracted segment point of view with said user point of view included in said user preference information, and extracts a plurality of said segments that have a matching said segment point of view in high-to-low order of said segment priority level.
 7. The content adaptation apparatus according to claim 3, wherein said metadata is composed of a segment point of view assigned to each said segment and indicating the contents of said segment, and a segment priority level assigned to each said segment point of view.
 8. The content adaptation apparatus according to claim 7, wherein said user adaptation section extracts said segment points of view from said metadata, compares said extracted segment points of view in order from a first user point of view to which a first user priority level was assigned to a second user point of view to which a second user priority level that is a lower user priority level than said first user priority level was assigned, and after extracting said segment that has said segment point of view matching said first user point of view, extracts said segment that has said segment point of view that has said second user point of view.
 9. The content adaptation apparatus according to claim 5, wherein said user preference information includes display duration information for said content.
 10. The content adaptation apparatus according to claim 9, wherein said user adaptation section extracts a number of said segments that can be displayed within the time indicated by said display duration information.
 11. The content adaptation apparatus according to claim 5, wherein said user preference information includes display spatial range information or display position information for said content.
 12. The content adaptation apparatus according to claim 11, wherein said user adaptation section extracts a number of said segments that can be displayed within the position range indicated by said display spatial range information or said display position information.
 13. The data adaptation apparatus according to claim 4, wherein with regard to said content, when there is a plurality of said segments that have the same said segment point of view, said same segment point of view is added to one of said segments that have said same segment point of view, and link information for said same segment point of view is added for other said segments that have said same segment point of view.
 14. The content adaptation apparatus according to claim 4, wherein said content further comprises a segment point of view table that contains a plurality of said segment points of view assigned to an included plurality of said segments.
 15. The content adaptation apparatus according to claim 4, wherein said segment point of view has link information that provides correspondence between said segment point of view and a target said segment.
 16. The content adaptation apparatus according to claim 4, wherein said segment has link information that provides correspondence between said segment and a target said segment point of view.
 17. The content adaptation apparatus according to claim 1, further comprising: a terminal information acquisition section which acquires terminal information that is the processing capability of a terminal that performs predetermined processing in said content adapted to said user preference information; and a resolution conversion section which performs resolution conversion of said adapted content according to said terminal information.
 18. The content adaptation apparatus according to claim 1, further comprising: a network output section which outputts to a network said content adapted to said user preference information; a network information acquisition section which acquires network information indicating the transmission band of said network; and a network adaptation section which adjusts the data quantity of said adapted content to be transmitted via said network according to said network information.
 19. The content adaptation apparatus according to claim 1, wherein said user preference information is stored beforehand in this apparatus.
 20. The content adaptation apparatus according to claim 1, wherein said user preference information is sent from said terminal that performs predetermined processing in said content adapted to said user preference information via a network.
 21. The data adaptation apparatus according to claim 1, wherein said user preferences are managed for each content identifier of said data.
 22. The data adaptation apparatus according to claim 1, wherein said user preferences are defined by means of DTD of XML.
 23. The data adaptation apparatus according to claim 1, wherein said user preferences are defined by means of XML Schema.
 24. A content adaptation method comprising: a step of acquiring content and metadata of said content; a step of acquiring user preference information relating to a user's preferences; and a step of adapting said content to said user preferences using said metadata.
 25. The content adaptation method according to claim 24, wherein: said user preference information is composed of user points of view for selecting arbitrary said segments from segments of said content; said metadata is composed of a segment point of view assigned to each said segment and indicating the contents of said segment, and a segment priority level assigned to each said segment point of view; and said user adaptation step extracts said segment point of view from said metadata, compares said extracted segment point of view with said user point of view included in said user preference information, and extracts said segment that has a matching said segment point of view.
 26. A data adaptation method comprising: a step of sending metadata of content from a server holding said content to a terminal apparatus via a network; a step of comparing a segment point of view assigned to each segment of said metadata and indicating the contents of said segment, with a user point of view for selecting an arbitrary said segment from segments of said content, included in user preference information relating to a user's preferences held beforehand in said terminal apparatus; a step of sending the result of said comparison to said server; and a step of said server selecting a segment of said content according to said result of said comparison, and transmitting the selected segment to said terminal apparatus.
 27. In a computer, a computer-readable storage medium that stores a program comprising: a step of acquiring content and metadata of said content; a step of acquiring user preference information relating to a user's preferences; and a step of adapting said content to said user preferences using said metadata.
 28. The computer-readable storage medium according to claim 27, wherein: said user preference information is composed of user points of view for selecting arbitrary said segments from segments of said content; said metadata is composed of a segment point of view assigned to each said segment and indicating the contents of said segment, and a segment priority level assigned to each said segment point of view; and said user adaptation step, in a computer, extracts said segment point of view from said metadata, compares said extracted segment point of view with said user point of view included in said user preference information, and extracts said segment that has a matching said segment point of view.
 29. In a computer, a program comprising: a step of acquiring content and metadata of said content; a step of acquiring user preference information relating to a user's preferences; and a step of adapting said content to said user preferences using said metadata.
 30. The program according to claim 29, wherein: said user preference information is composed of user points of view for selecting arbitrary said segments from segments of said content; said metadata is composed of a segment point of view assigned to each said segment and indicating the contents of said segment, and a segment priority level assigned to each said segment point of view; and said user adaptation step, in a computer, extracts said segment point of view from said metadata, compares said extracted segment point of view with said user point of view included in said user preference information, and extracts said segment that has a matching said segment point of view. 